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Abstract 

I show that physical devices that perform observation, prediction, or recollection share an underlying math- 
ematical structure. I call devices with that structure "inference devices". I present a set of existence and 
impossibility results concerning inference devices. These results hold independent of the precise physical 
laws governing our universe. In a limited sense, the impossibility results establish that Laplace was wrong 
to claim that even in a classical, non-chaotic universe the future can be unerringly predicted, given sufficient 
knowledge of the present. Alternatively, these impossibility results can be viewed as a non-quantum me- 
chanical "uncertainty principle". Next I explore the close connections between the mathematics of inference 
devices and of Turing Machines. In particular, the impossibility results for inference devices are similar to 
the Halting theorem for TM's. Furthermore, one can define an analog of Universal TM's (UTM's) for in- 
ference devices. I call those analogs "strong inference devices". I use strong inference devices to define the 
"inference complexity" of an inference task, which is the analog of the Kolmogorov complexity of com- 
puting a string. However no universe can contain more than one strong inference device. So whereas the 
Kolmogorov complexity of a string is arbitrary up to specification of the UTM, there is no such arbitrariness 
in the inference complexity of an inference task. I end by discussing the philosophical implications of these 
results, e.g., for whether the universe "is" a computer. 
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1. Introduction 

Some of the most fruitful investigations of the foundations of physics began by identifying a 
set of features that are present in all physical realizations of a particular type of information pro- 
cessing. The next step in these investigations was to abstract and formalize those shared features. 
Once that was done, one could explore the mathematical properties of those features, and thereby 
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analyze some aspects of the relationship between physics and information processing. Examples 
of such investigations include the many decades of work on the relationship between physics 
and computation [1 1I12I13I14I15I16I17I18I19I20I21I22I23T22124J . the work on observation that 
started with Everett's seminal paper ll25l . and more recent work that considers what possible 
forms physical reality might have I26I27I28I29I30I3 1 132I33I34I35I36I . 

In this spirit, here we first present archetypal examples of physical devices that perform obser- 
vation, of physical devices that perform prediction, and of physical devices that perform recollec- 
tion. We then identify a set of features common to those examples. This is our first contribution, 
that such physical devices share those features. 

Next we formalize those features, defining any device possessing them to be an "inference 
device". To do this requires our second contribution: a formalization of the concept of semantic 
information contentU Loosely speaking, we define the semantic information content of a vari- 
able s concerning a variable r to be what an external scientist can infer about what the value of r 
is in their particular universe by knowing the state of s. Note the central role in this definition of 
the scientist external to the device. As discussed below, in the context of using inference devices 
for observation, this central role of the external scientist is in some ways more consistent with 
Wigner's view of the observation process than with the many-worlds view of that process. 

For the remainder of the paper we develop the theory of inference devices, thereby analyzing 
numerous aspects of the relationship between physics and information processing. Our goal in 
this endeavor is to illustrate the breadth of the theory of inference devices; an exhaustive analysis 
of any one aspect of that theory is beyond what can fit into this single paper. 

A recurring theme in our analysis of inference devices is their relationship with Turing Ma- 
chines (TM's). In particular, there are impossibility results for inference devices that are similar 
to the Halting theorem for TM's. Furthermore, one can define an analog of Universal TM's 
(UTM's) for inference devices. We call those analogs "strong inference devices". 

A central result of this paper is how to use strong inference devices to define the "inference 
complexity" of an inference task, which is the analog of the Kolmogorov complexity of com- 
puting a string. A task-independent bound is derived on how much the inference complexity of 
an inference task can differ for two different inference devices. This is analogous to the "encod- 
ing" bound governing how much the Kolmogorov complexity of a string can differ between two 
UTM's used to compute that string. However no universe can contain more than one strong in- 
ference device. So whereas the Kolmogorov complexity of a string is arbitrary up to specification 
of the UTM, there is no such arbitrariness in the inference complexity of an inference task. 

After presenting inference complexity, we informally discuss the philosophical implications 
of all of our results to that point. In particular, we discuss what it might mean for the universe 
to "be" a computer We also show how much of philosophy can be reduced to constraint satis- 
faction problems, potentially involving infinite-dimensional spaces. We follow this discussion by 
deriving some graph-theoretic properties governing the possible inference relationships among 
any set of multiple inference devices in the same universe. 

Our next contribution is an extension of the inference devices framework to include physical 
devices that are used for control. Associated impossibility results provide fundamental limits on 
the capabilities of physical control systems. After this we present an extension of the framework 
to probabilistic inference devices. Of all the results in this paper, it is the impossibility results 
concerning probabilistic inference devices that are the most similar to quantum mechanical im- 
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possibility results. We end by presenting an extension of the framework that clarifies its relation 
with semantic information. 

The crucial property underlying our results is that inference devices are embodied in the very 
physical system (namely the universe) about which they are making inferences. This embedding 
property and its consequences have nothing to do with the precise laws governing the underly- 
ing universe. In particular, those consequences do not involve chaotic dynamics as in II17I18L 
nor quantum mechanical indeterminism. Similarly, they apply independent of the values of any 
physical constants (in contrast, for example, to the work in |T2|), and more generally apply to 
every universe in a multiverse. Nor do the results presume limitations on where in the Chomsky 
hierarchy an inference device lies. So for example they would apply to oracles, if there can be 
oracles in our universe. In the limited sense of our impossibility results, Laplace was wrong to 
claim that even in a classical, non-chaotic universe the future can be unerringly predicted, given 
sufficient knowledge of the present ll38l . Alternatively, these impossibility results can be viewed 
as a non-quantum mechanical "uncertainty principle". 

All non-trivial proofs are in App. A. An earlier analysis addressing some of the issues consid- 
ered in this paper can be found in ||26| . 

1.1. Notation 

We will take the set of binary numbers B to equal {-1, 1), so that logical negation is indicated 
by the minus sign. We will also take © to be the Heaviside theta function that equals 1 if its 

argument is non-negative, otherwise. N is the natural numbers, 1,2, For any function F 

with domain U, we will write the image of U under F as F(L'). For any function F with domain 
U that we will consider, we implicitly assume that T{U) contains at least two distinct elements. 
For any (potentially infinite) set W, |W| is the cardinality of W. For any real number a E R, ["a 
is the smallest integer greater than or equal to a. Given two functions Fi and F2 with the same 
domain U, we write Fi ® F2 for the function with domain U obeying u e U (Fi(m), F2(m)), 
and with some abuse of terminology refer to this as the "product" of Fi and F2. 

Given a function F with domain U, we say that the partition induced by F is the family of 
subsets {F"'(y) : y E F(t/)). Intuitively, it is the family of subsets of U each of which consists 
of all elements having the same image under F. We will say that a partition A over a space U 
is a flne-graining of a partition B over U (or equivalently that B is a coarse-graining of A) iff 
every a £ A is a subset of some b e B. Two partitions A and B are fine-grainings of each other iff 
A - B. Say a partition A is finite and a fine-graining of a partition B. Then |A| - \B\ iff A = B. 

Given a probability measure, the mutual information between two associated random variables 
a, b conditioned on event c is written M(fl, b \ c). The Shannon entropy of random variable a is 
H(fl). 

2. Archetypal examples 

We now illustrate that many (if not all) physical realizations of the processes of observation, 
prediction, and memory share a certain mathematical structure. We do this by semi-formally 
describing each of those processes, one after the other. Each such description uses language 
that is purposely very similar to the other descriptions. It is that very similarity of language that 
demonstrates that the same mathematical structure arises as part of each of the processes. In the 
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following sections of this paper we will formalize that mathematical structure, and then present 
our formal results concerning itO] 

If the reader becomes convinced of this shared mathematical structure before reading through 
all the examples, (s)he is encouraged to skip to the next section. It is in that section that we 
formalize the shared mathematical structure, as an "inference device". 

In all of the examples in this section, U is the space of all worldlines of the entire universe 
that are consistent with the laws of physics (whatever they may be), and u indicates an element 

off/E] 

Example 1: We start by describing a physical system that is a general-purpose observation de- 
vice, capable of observing different aspects of the universe. Let S be some particular variable 
concerning the universe whose value at some time f2 we want our device to observe. If the uni- 
verse's worldline is u, then the value of S at f2 is given by some function of u (e.g., it could be 
given by a component of u). Write that function as F; S(t2) - T(u). 

The observation device consists of two parts: an observation apparatus, and a scientist who 
uses (and interprets) that apparatus. To make our observation, the scientist must first configure 
the observation apparatus to be in some appropriate state at some time t\ < t2. (The idea is that 
by changing how the observation apparatus is configured the scientist can change what aspect 
of the universe he observes.) That configuration of the observation apparatus at f i is also given 
by a function of the entire universe's worldline u, since the observation apparatus exists in the 
universe. Write that function asx, with range ;(f(t/). 

The goals is that if the apparatus has been properly configured, then sometime after ti it cou- 
ples with S in such a way that at some time tj > t2, the output display of the observation apparatus 
accurately reflects 5'(f2)- Again, that output display exists in the universe. So its state at is a 
function of u; write that function as 

The scientist reads the output of the apparatus and interprets that output as this attempted 
observation of 5'(f2)- It is this interpretation that imbues that output with semantic information. 
Without such interpretation the output is just a meaningless (!) pattern, one that happens to be 
physically coupled with the variable being observed. (As an extreme example of such meaning- 
less coupling, if a tree falls in a forest, but the video that recorded the fall is encrypted in a way 
that the scientist cannot undo, then the scientist does not "observe" that the tree fell by watching 
the video .) 

To formalize what such interpretation means, we must define "semantic information". As men- 
tioned above, we want the semantic information of a variable s concerning a variable r to be what 
an external scientist can infer about r by knowing the state of s. In the current example this means 
we require that the scientist can ask questions of the sort, "Does 5'(f2) = KT' at t^, and that ((u) 
provides the scientist with (possibly erroneous) answers to such questions. As an example, say 
that ^(m) is a display presenting integers from to 1000, inclusive, with a special 'error' symbol 
for integers outside of that range. Since the scientist interprets the value on that display at tj, as 
the outcome of the observation of S{t2), by looking at the display at the scientist is provided 



Some might quibble that one or another of the these examples should involve additional structure, that what is presented 
in that example does not fully capture the physical processes it claims to describe. (See App. B.) The important point is 
that the structure presented in these examples is always found in real-world instances of the associated physical processes. 
Whether or not there is additional structure that "should" be assumed is not relevant. The structure that is assumed in the 
examples is sufficient to establish our formal results. 

^ For expository simpHcity we use the language of non-quantum mechanical systems in this paper However most of 
what follows holds just as well for a quantum-mechanical universe, if we interpret quantum mechanics appropriately. 
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with (possibly erroneous) answers to the question "Does Sit2) = KT' for all 1001 values of K 
that can be on the display. 

To make this more precise, first note that any question like "Does S (12) - KT can either be 
answered 'yes' or 'no', and therefore is a binary function of u. For every K, write this associated 
binary function of u as qx', ^K, Vm e U, qKiu) = 1 if 5 (fa) - T(u) - K, and it equals -1 otherwise. 
Next, note that the brain of the scientist exists in the universe. So which (if any) of a set of such 
possible binary questions concerning the universe the scientist is asking at is also a function 
of M. We write that function as Q. In particular, we presume that any question is one of the 
elements in the range of Q, i.e., it is one of the questions that (depending on the state of the 
scientist's brain then) the scientist might be asking at t^. 

Now for any particular question the scientist might be asking at tj,, the answer that the 
scientist provides by interpreting the apparatus' output is a bit. The value of that bit is specified 
by the state of the scientist's brain at fs. (The premise being that the state of the scientist's brain 
was affected by the scientist's reading and then interpreting the apparatus' output.) So again, 
since the scientist's brain exists in the universe, the value of that answer bit is a function of u. We 
write that function as Y. 

It is the combination of Q and Y that comprise the scientist's "interpretation" of f , and thereby 
imbue any particular ^(u) with semantic content. Q{u) specifies a question qK- l^{u) then causes 
F(m) to have some associated value. We take that value to be (the scientist's interpretation of) the 
apparatus' answer to the question of whether qK{u) = 1 or qK{u) - -\ (i.e., of whether 5 (fa) = 
K). Combining, ^(m) causes Y{u) to have a value that we take to be (the scientist's interpration 
of) the apparatus' answer to whether [2(m)](m) = 1 or [2(m)](m) = -1. 

This scenario provides a set of requirements for what it means for the combination of the 
observation apparatus and the scientist using that apparatus to be able to successfully observe the 
state of 5 at t2: First, we require that the scientist can configure the apparatus in such a way that 
its output at ?3 gives r(M). We also require that the scientist can read and interpret that output. 
This means at a minimum that for any question of the form "Does r(M) = KT the scientist can 
both ask that question at fa and interpret ^(m) to accurately answer it. 

To make this fuUy formal, we introduce a set of binary functions with domain T{U): VK, /k : 
y -> 1 iff y = A". Note that we have one such function for every K € TiU). Our requirement 
for successful observation is that the observation apparatus can be configured so that, for any f^, 
if the scientist were to consider an associated binary question at f3 and interpret ^(m) to answer 
the question, then the scientist's answer would necessarily equal fK(r(u)). In other words, there 
is a value c e x(U) such that for any K G r(f/), there is an associated Qk g QiU) such that the 
combination of x(m) = c and Q{u) = Qk implies that Y{u) = fKir(u)). 

Intuitively, for the scientist to use the apparatus to "observe S (fa)" only means the scientist 
must configure the apparatus appropriately; the scientist must force the universe to have a world- 
line u such that^(M) = c, and that must in turn cause ^(u) to accurately give r(M). In particular, 
to "observe S (fa)" does not require that the scientist impose any particular value on Qiu). Rather 
Q's role is to provide a way to interpret ^(u). The only requirement made of Q is that i/the sci- 
entist were to ask a question like "Does S (fa) equal KT, then Q{u) — determined by the state 
of the scientist's brain at ts — would equal that question, and the scientist's answer Y(u) would 
be appropriately set by ^(m). It is by using Q this way that we formalize the notion that ^{u) 
conveys information to the scientist concerning S (fa). The "observation is successful" if for any 
such question the scientist might pose (as reflected in Q(u)), their associated answer (as reflected 
in F(m)) properly matches the state of S at ?2- 

We can motivate this use of 2 in a less nuanced, more direct way. Consider a scenario where 
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the scientist cannot both pose all binary- valued questions fx concerning S (?2) and correctly an- 
swer them using the apparatus output, ((u). It would seem hard to justify the view that in this 
scenario the combination of the scientist with the apparatus makes a "successful observation" 
concerning 5 fe). 

Note that by defining an observation device as the combination of an observation appara- 
tus with the external scientist who is using that apparatus, we are in a certain sense arriving at 
a Wignerian approach to observation. In contrast to a more straight-forward many-worlds ap- 
proach, we require that the state of the observation apparatus not just be correlated with the 
variable being observed, but in fact contain semantic information concerning the variable be- 
ing observed. This makes the external scientist using the observation apparatus crucial in our 
approach, in contrast to the case with the many-worlds approach. 

Example 2: This example is a sUght variant of Ex. 1. In this variant, there is no scientist, just 

"inanimate" pieces of hardware. 

We change the apparatus of Ex. 1 slightly. First, we make the output f be binary-valued. We 
also change the configuration function;^^, so that in addition to its previous duties, it also specifies 
a question of the form, "Does r{u) equal KT\ Then observation is successful if for any K E r(U), 
the apparatus can be configured appropriately, so that its output correctly answers the question 
of whether S (fa) equals K. In other words, observation is successful if for any K € r(U) there is 
an associated c €xiU) such that having ;^f(M) = c implies that Y{u) = /jf(r(M)). 

Example 3: We now describe a physical system that is a general-purpose prediction device, 
capable of correctly predicting different aspects of the universe's future. Let S be some particular 
variable concerning the universe whose value at some time t2 we want our device to predict. If 
the universe's worldline is u, then the value of S at is given by some function of u which we 
write as F; S (fa) = F(m). 

The prediction device consists of two parts, a physical computer, and a scientist who programs 
that computer to make the prediction and interprets the computer's output as that prediction. To 
"program the computer" means that the scientist initializes it at some time ti < t2 to contain 
some information concerning the state of the universe and to run a simulation of the dynamics of 
the universe that uses that information. Accordingly, to "program the computer" to perform the 
prediction means making it be in some appropriate state at ti . (The idea is that by changing how 
the computer is programmed, the scientist can change what aspect of the universe the computer 
predicts.) That initialization of the computer is also given by a function of the entire universe's 
worldUne u, since the computer exists in the universe. Write that function asx, with range x(f/)- 

The hope is that if the computer is properly programmed at t\ , then it runs a simulation con- 
cerning the evolution of the universe that completes at some time > ti, and at that time displays 
a correct prediction of S (fa) on its output. (In general we would Uke to also have fa < t2, so that 
the simulation completes before the event being predicted actually occurs, but we don't require 
that.) Again, that output display exists in the universe. So its state at fs is a function of u; write 
that function as 

The scientist reads the output of the computer and interprets it as this attempted prediction of 
S (fa), thereby imbuing that output with semantic meaning. More precisely, for the value f (m) to 
convey information to the scientist at fa, we require that the scientist can ask questions of the sort, 
"Does 5 (fa) - KT at fa, and that ^(w) provides the scientist with (possibly erroneous) answers 
to such questions. 

As in Ex. 1, to make this more formal, we note that any question hke "Does 5 (fa) = KT is a 
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binary function of u, of the sort presented in Ex. 1. Also as in Ex. 1, the brain of the scientist 

exists in the universe. So which (if any) of a set of possible questions concerning the universe 
the scientist is asking at is also a function of u, which we again write as Q. Also as in Ex. 1, 
the answer of the scientist to any such question is a bit that the scientist generates by interpreting 
^(m). Since that answer is given by the state of the scientist's brain at ?3, it is a function of u, 
which as before we write as Y. 

So for the combination of the computer and the scientist using that computer to be able to 
successfully predict the state of S at t2 means two things: First, we require that the scientist 
can program the computer in such a way that its output at gives r(u). We also require that 
the scientist can read and interpret that output. More precisely, our requirement for successful 
prediction is that the computer can be programmed so that, for any /k, if the scientist were to 
consider an associated binary question at tj, and interpret ((u) to answer the question, then the 
scientist's answer would necessarily equal /^(r(M)). In other words, there is a value c e x(U) 
such that for any K e r{U), there is an associated q/^ e Q(U) such that the combination of 
Xiu) - c and Q(u) = qg implies that Y(u) = fxiriu)). 

Just as in Ex. 1 , for the scientist to use the apparatus to "predict S (txY' only means the scientist 
must program the computer appropriately; the scientist must force the universe to have a world- 
hne M such that;(f(M) = c, and that must in turn cause ^(m) to accurately give r{u). In particular, to 
"predict S (fa)" does not require that the scientist impose any particular value on Qiu). As before, 
Q's role is to provide a way to interpret ^(m). 

Note that the "computer" in this example is defined in terms of what it does, not in terms of 
how it does it. This allows our formalization of prediction to avoid all issues of where exactly in 
the Chomsky hierarchy some particular physical computer might lie. 

Nothing in the formahzations ending Ex.'s 1-3 relies on the precise choices of time-ordering 
imposed on the values fi, ?2, ^3, k- Those formahzations only concern relations between functions 
r, fk, Q, (, and Y, each having the entire worldline across all time as its domain. This fact means 
that the same sort of formaUzation can be applied to "retrodiction", as elaborated in the following 
example. 

Example 4: Say we have a system that we want to serve as a general-purpose recording and 
recollection device, capable of correctly recording different aspects of the universe and recalhng 
them at a later time. Let S be some particular variable concerning the universe whose value at 
some time h we want our device to record. If the universe's worldline is m, then the value of S at 
?2 is given by some function of u which we write as the function F; S (ti) = F(m). 

The recording device consists of two parts. The first is a physical recording apparatus that 
records many characteristics of the universe. The second is a scientist who queries that apparatus 
to see what it has recorded concerning some particular characteristic of the universe, and inter- 
prets the apparatus' response as that recording. To "query the apparatus" means that the scientist 
makes some variable concerning the apparatus be in an appropriate state at some time t\ > t2- 
(The idea is that by changing how the apparatus is queried, the scientist can change what aspect 
of the universe's past the apparatus displays to the scientist.) That state imposed on the variable 
concerning the apparatus at t\ is also given by a function of the entire universe's worldline u, 
since the apparatus exists in the universe. Write that function as;t'' with range x{U). 

The hope is that if the apparatus functions properly and is properly queried at h, then it re- 
trieves an accurate recording of S (fa), and displays that recording on its output at some time 
t-i > h. Again, that output display of the apparatus exists in the universe. So its state at fs is a 
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function of u; write that function as (. 

The scientist reads the output of the apparatus and interprets it as this recording of S{t2), 
thereby imbuing that output with semantic meaning. More precisely, for the value ^(m) to convey 
information to the scientist at f3, we require that the scientist can ask questions of the sort, "Does 
S(t2) - KT' at f3, and that ^(m) provides the scientist with (possibly erroneous) answers to such 
questions. 

As in Ex. 1, to make this more formal, we note that any such question is a binary function of u, 
of the sort qx presented in Ex. 1. Also as in Ex. 1, the brain of the scientist exists in the universe. 
So which (if any) of a set of possible questions concerning the universe the scientist is asking at 
f3 is also a function of u, which we again write as Q. Also as in Ex. 1, the answer of the scientist 
to any such question is a bit that the scientist generates by interpreting ({u). Since that answer is 
given by the state of the scientist's brain at t^, it is a function of u, which as before we write as Y. 

So for the combination of the apparatus and the scientist using that apparatus to be able to 
successfully record and recall the state of S at t2 means two things: First, we require that the 
scientist can query the apparatus in such a way that its output at tj gives r(M). We also require 
that the scientist can read and interpret that output. More precisely, our requirement for successful 
recording and recollection is that the apparatus can be queried so that, for any ffc, if the scientist 
were to consider an associated binary question at and interpret ((u) to answer the question, 
then the scientist's answer would necessarily equal fic(r(u)). In other words, there is a value 
c exiU) such that for any K e r(U), there is an associated e QiU) such that the combination 
ofxiu) = c and Q{u) - qx implies that Y{u) = fxiTiu)). 

Just as in Ex. 1, for the scientist to use the apparatus to "recall 5 (f2)" only means the scientist 
must query the apparatus appropriately; the scientist must force the universe to have a worldline 
u such ihai x(m) - c, and that must in turn cause ^(m) to accurately give Y(u). In particular, to 
"recall 5(f2)" does not require that the scientist impose any particular value on Q{u). As before, 
2's role is to provide a way to interpret ^(m). 

Note that nothing in this example specifies how the recording process operates. This is just like 
how nothing in Ex. 1 specifies how the observation apparatus couples with S , and how nothing 
in Ex. 3 specifies what simulation the computer runs. 

See 0911 1I30J for discussion about the crucial role that recollection devices play in the psy- 
chological arrow of time, and of the crucial dependence of such devices on the second law of 
thermodynamics. As a result of their playing such a role, the limitations on recollection devices 
derived below have direct implications for the psychological and thermodynamic arrows of time. 

Just as Ex. 2 varies Ex. 1 by removing the scientist, so Ex.'s 3 and 4 can be varied to remove 
the scientist. 



3. Basic concepts 

In this section we first formahze the mathematical structure that is shared among Ex.'s 1-4 of 
Sec. 121 In doing so we substantially simplify that structure. After this formalization of the shared 
structure in the examples we present some elementary results concerning that structure. 



8 



3.1. Inference devices 

Definition 1: An (inference) device over a set f/ is a pair of functions {X, Y), both with domain 
U. Y is called the conclusion function of the device, and is surjective onto B. X is called the 
setup function of the device. 

As an illustration, in all of Ex.'s 1-4, the setup function is the composite function (x, Q), and 
the conclusion function is Y. The value of X(u) can loosely be interpreted as how the device is 
"initialized / configured"|3 The value of Y(u) should instead be viewed as all that the device 
predicts /observes / recollects when it is done. A priori, we assume nothing about how X and Y 
are related. Note that we do not require that the compound map (X,Y) : u e U {X, Y){u) be 
surjective. There can be pairs of values x e X{U), y e Y(U) that never arise for the same u. 

Given some function F with domain U and some y 6 r(U), we are interested in setting up a 
device so that it is assured of correctly answering whether r{u) - y for the actual universe u. 
Loosely speaking, we will formalize this with the condition that Y{u) = 1 iff Tiu) - j for all u 
that are consistent with some associated setup value of the device, i.e., such that X(u) - x. If this 
condition holds, then setting up the device to have setup value x guarantees that the device will 
make the correct conclusion concerning whether Y(u) - y. (Hence the terms "setup function" 
and "conclusion function" in Def. 1.) 

Note that this desired relationship between X, Y and F can hold even if X{u) - x doesn't 
fix a unique value for Y(u). Such non-uniqueness is typical when the device is being used for 
observation. Setting up a device to observe a variable outside of that device restricts the set of 
possible universes; only those u are allowed that are consistent with the observation device being 
set up that way to make the desired observation. But typically just setting up an observation 
device to observe what value a variable has doesn't uniquely fix the value of that variable. 

In general we will want to predict / observe / recollect a function F that can take on more than 
two values. This is done by appropriately choosing X{u). As mentioned, X{u) specifies what is 
known about the outside world together with a simulation program (in the case of computer- 
based prediction), or a specification of how to set up an observation apparatus (in the case of 
observation), or a specification of what to remember (in the case of a memory device). But in 
addition, in all those cases X(u) specifies one of the possible values of F(m) (i.e., it specifies a 
question of the form "Does F(m) - y?"). We then view the device's conclusion bit as saying 
whether F(m) does / doesn't have that specified value. So for example if our device is a computer 
being used to predict the value of some variable concerning the state of the world, then formally 
speaking, the setup of the computer specifies a particular one of the possible values of that vari- 
able (in addition to specifying other information like what simulation to run, what is known about 
the outside world, etc.). Our hope is that the computer's conclusion bit correctly answers whether 
the variable has that value specified in how the computer is set up. 

Intuitively, this amounts to using a unary representation of F(f/). To formalize this with mini- 
mal notation, we will use the following shorthand: 

Definition 2: Let A be a set having at least two elements. A probe of A is a mapping from A onto 
B that equals 1 for one and only one argument a e A. 



Care should be taken with this interpretation though. For example, in Ex. \,x concerns the state of u at tiine t\ , and Q 
concerns the state of u at tj.SoX "straddles multiple times". 
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So a probe of A is a function that picks out a single one of A's possible values, i.e., it is a 
Kronecker delta function whose second argument is fixed, and whose image value is replaced 
by-1. 

3.2. Notation for inference devices 

We now have the tools to define what it means for an inference device to successfully observe 
/ predict / recall. Before presenting that definition we introduce some useful notation. 

Unless specified otherwise, a device written as "C," for any integer / is implicitly presumed 
to have domain U, with setup function X, and conclusion function F, (and similarly for no sub- 
script). Similarly, unless specified otherwise, expressions like "rmn;^," mean mirij^jex.cfyj- 
We define a probe of a device to be a probe of the image of the device's conclusion function. 
Given a function T with domain U and a probe / of T(U), we write /(F) as shorthand for the 
function u e U f(r(u)). We write 7r(A) to indicate the set of all probes of a set A, and 7r(r) to 
indicate the set of functions over U, {/(F) : / € 7r(T{U))]. 

Probes are a shorthand way of posing queries concerning membership in a set (e.g., queries 
like "is it true that u 6 Y^^{y) for some particular value yT'). All such queries are binary-valued 
(which is why the range of probes is B). So couching the analysis in terms of probes essentially 
amounts to representing all associated spaces in terms of bits. This has the advantage that it 
allows us to avoid considering the ranges of any functions that arise in the analysis. In particular, 
it allows us to avoid concern for whether one such range "matches up" with the domains and/or 
ranges of other functions. For example, it allows us to avoid concern for such matching between 
the spaces defining two diff'erent inference devices when considering whether they infer each 
other. (See flE] for a more elaborate way of circumventing the need of those ranges to match.) 

Say we are given a set of functions over U, {D\,d\,D2,d2, ■ ■ . £1, ei, £2, e2, ■ ■ ■}■ Then with 
some abuse of terminology, we write "Di = d\,D2 - d2, ■ ■ ■ => £1 - e\,E2 - 62, ■ ■ •" as 
shorthand for "3 u e U such that D\(u) - d\{u),D2 - d2, ■ ■ ., and 'i u e U such that D\{u) = 
d\(u),D2 - d2, ■ ■ ; it is the case that Ei{u) = e\{u),e2{u) - E2{u), . . .". We will often abuse 
notation even further by allowing di to be an element of Dfs range. In this case, "Di = c/i 
£1 = ei" is shorthand for"3M e U such that Di = di, and 'i u e U such that Diiu) - d\, it is also 
the case that E\{u) - eiiu)". 

3.3. Weak inference 

We can now formalize inference as follows: 

Definition 3: A device C (weakly) infers a function F over U iff 'if e n(r), 3 x such that 
X^x^Y^ /(F). 

So using the definitions in the previous subsection, C weakly infers F iff V/ E 7r(F), 3 x e X(U) 
such that for all m e f/ for which X{u) - x, Y(u) = /(F(m)). 

Recall our stipulation that all functions over U take on at least two values, and so in particular 
F must. Therefore ;r(F) is non-empty. We will write C > F if C infers F. Expanding our shorthand 
notation, C > F means that for all y e F(C/), 3x e X{U) with the following property: iu e U : 
X{u) - X, it must be that Y(u) - fy(r(u)), where fy : F(t/) — » B is the probe of F's range that 
equals 1 iff" F(m) = y. 
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Intuitively, to have C > T means that if the image value of T is expressed as a list of answers to 
questions of the form "Does r{u) = y?", then we can set up the device so that it will guaranteedly 
correctly conclude any particular answer in that list. Alternatively, the requirement that there be 
an appropriate x for any probe function of F can be viewed as shorthand; in the definition of 
inference we are considering the ability of a device to correctly answer any member of a list 
of binary-valued questions, a set that is "generated" by F. So weak-inference is a worst-case 
definition: if a device C weakly infers F, then no matter what probe / € 7r(r) a maUcious demon 
might choose, the scientist could guarantee that Y = /(F) by choosing an associated value x for 
the value of X. 

To illustrate this, consider again Ex. 1. Identify the Y in Def. 3 with the Y in Ex. 1, and 
similarly identify the F's with each other Then identify the function X in Def. 3 as the product 
of functions, (g) Q. {X, Y) specifies a device C. The functions /k in Ex. 1 are the probes in 7r(F). 
So if C > F, then the aggregate system of scientist and observation apparatus can observe 5 (fa). 
Note that ^ ends up being irrelevant. In essence, it serves as a conduit to transfer information into 
the scientist's brain. 

In the many-worlds definition of an observation, any particular result of the observation is 
identified with a solitary worldline u. Intuitively, this might be worrisome; a solitary u is just a 
single point in a space, with no intrinsic mathematical structure. The properties of such a single 
point can be drastically modified by an appropriate isomorphism over U. In particular, as has 
been pointed out by many authors, in the many-worlds definition what gets "observed" can be 
modified if one changes the basis of U. (This is one of the major motivations for the work on 
decoherence II40I41I .') 

However if a scientist makes an observation, then that scientist could provide the value of 
any (binary-valued) function of the result of the observation, if they were asked to. So formally 
requiring that the scientist be able to provide such values doesn't preclude real-world instances 
of observation. At the same time, adding such a requirement has substantial consequences. In 
fact, it drives many of the results presented below concerning weak inference. This is why this 
requirement is incorporated into the definition of weak inference. In other words, it is why the 
definition of weak inference inherently involves multiple worldlines u, in contrast to the many- 
worlds definition of observation. 

See Sec. 16.21 for a discussion of the philosophical aspects of weak inference. The relation 
between weak inference and the theory of knowledge functions |42'43 '44"451 is briefly discussed 
in Sec. |9] App. B contains a discussion of how unrestrictive the definition of weak inference is. 
Finally, some alternative definitions of devices and weak inference are considered in App. C. 

3.4. Elementary results concerning weak inference 

We say that a device C\ infers a set of functions if it infers every function in that set. We also 
say C\ infers a device C2 iff" C\ > ia- In general inference among devices is non-transitive. In 
addition we have the following elementary properties of devices: 

Proposition 1: Let {F, } be a set of functions with domain U and W (Z U. 

i) If V/, |F,(W)| > 2, then there is a device over U that infers {F,}. 

ii) For any device C, there is a binary-valued function that C does not infer. 

Prop. l(ii) means in particular that there are sets {F, } such that no device can infer every function 
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in that set. 

In a limited sense, when appUed to prediction (cf. Ex. 1), Prop. l(ii) means that Laplace was 
wrong: even if the universe were a giant clock, he would not have been able to reliably predict the 
universe's future state before it occurredO] Viewed differently. Prop. l(ii) means that regardless 
of noise levels and the dimensions and other characteristics of the underlying attractors of the 
physical dynamics of various systems, there cannot be a time-series prediction algorithm I48l 
that is always correct in its prediction of the future state of such systems. 

Note that time does not appear in Def. 3's model of a prediction system. So in particular in 
Ex. 3 we could have tj, < ti — so that the time when the computer provides its prediction is 
after the event it is predicting — and the impossibility result of Prop. l(ii) still holds (cf. Ex. 
4). Moreover, the program that is input to the prediction computer via the value of x could even 
contain the value that we want to predict. Prop. l(ii) would still mean that the conclusion that the 
computer's user comes to after reading the computer's output cannot be guaranteed to be correct. 

This is all true even if the computer has super- Turing capability, and does not derive from 
chaotic dynamics, physical limitations like the speed of light, or quantum mechanical limitations. 
Indeed, when applied to an observation apparatus like in Ex. 1, Prop. l(ii) can be viewed as a 
sort of non-quantum mechanical "uncertainty principle", establishing that there is no general- 
purpose, infallible observation device. (See also Prop. 6 below, which is perhaps more closely 
analogous to the uncertainty principle.) In addition, when applied to the recording apparatus of 
Ex. 4, Prop. l(ii) means that there is no general -purpose, infallible recording device. 

To illustrate this in more detail, consider the relatively simple scenario where C is a computer 
making a prediction at time t about the state of the (deterministic, classical) universe at f' > t. 
Let G be the set of all time-f states of the universe in which C's output display is -i-L The laws 
of physics can be used to evolve G forward to time t' . Label that evolved set of time-f' states of 
the universe as H. Let F be the binary-valued question, "does the state of the universe at t' lies 
outside of //?". 

There is no information concerning H that can be programmed into C at some time r < t 
that guarantees that the resultant prediction that C makes at f is a correct answer to that question. 
This is true no matter what r is, i.e., no matter how much time C has to run that program before 
making its answer at time t. It is also true no matter how much time there is between t' and f. It 
is even true if the program with which C is initialized explicitly gives the correct answer to the 
question. 

Similar results hold if t' < t. In particular, such results hold if C is an observation device 
that we wish to configure so that at time f it correctly completes an observation process saying 
whether the universe was outside of H at time f'. We can even have f' be earlier than the time 
when C is set up. In this case, C is a recording system that contains information about the past 
and we wish to query it about whether the universe was outside of H at t'. See ||26| for further 
discussion of these points. 

While these limitations are unavoidable, often they are not relevant, in that we are not inter- 
ested in whether a device infers an arbitrary set of functions. Instead, often we are interested in 
whether a devices infers some specified subset of all functions. Prop. l(i) addresses that situation. 



Similar conclusions have been reached previously |46,47 |. However in addition to being Hmited to the inference 
process of prediction, that earlier work is quite informal. Furthermore, it unknowingly disputes well-established results 
in engineering. For example, the claim in 1461 that "a prediction concerning the narrator's future ... cannot ... account 
for the effect of the narrator's learning that prediction" is refuted by adaptive control theory and Bellman's equations. 
Similarly, those with training in computer science will recognize statements (A3), (A4), and the notion of "structurally 
identical predictors" in |47 1 as formally meaningless. 
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In particular, given our assumption that any function over U must contain at least two values in 
its range, it immediately implies the following: 

Corollary 1: 

i) Let {r,) be a set of functions with domain f/ and W c f/. If Vj, r,(f/) = r,(W), 
then there is a device that infers {F,}. 

ii) For any function F with domain U there is a device that infers F. 

Another implication of Prop. l(i) is the following: 

Corollary 2: Let C - (X, Y) be a device over U where the partition induced by X is a fine- 
graining of the partition induced by Y. Then > 2 iff there is a function that C infers. 

Prop. l(ii) tells us that any inference device C can be "thwarted" by an associated function. 
However it does not forbid the possibility of some second device that can infer that function that 
thwarts C. To analyze issues of this sort, and more generally to analyze the inference relationships 
within sets of multiple functions and multiple devices, we start with the following definition: 

Definition 4: Two devices {X\ , Yi) and (X2, F2) are (setup) distinguishable iff V xi , X2, 3u€U 

S.t. Xi(u) = Xi,X2iu) = X2. 

No device is distinguishable from itself. Distinguishability is non-transitive in general. Having 
two devices be distinguishable means that no matter how the first device is set up, it is always 
possible to set up the second one in an arbitrary fashion; the setting up of the first device does not 
preclude any options for setting up the second one. Intuitively, if two devices are not distinguish- 
able, then the setup function of one of the devices is partially "controlled" by the setup function 
of the other one. In such a situation, they are not two fully separate, independent devices. 

By choosing the negation probe f(y e B) = -y we see that no device can weakly infer itself. 
We also have the following: 

Theorem 1: No two distinguishable devices can weakly infer each other. 

Thm. 1 says that no matter how clever we are in designing a pair of inference devices, so long 
as they are distinguishable from each another, one of them must thwart the other, providing a 
function that the other device cannot infer. Whereas the impossibility result of Prop. l(ii) relies 
on constructing a special function F matched to C, the implications of Thm. 1 are broader, in that 
they establish that a whole class of functions cannot be inferred by C (namely the conclusion 
functions of devices that are distinguishable from C and also can infer C). It is important to 
note that the distinguishability condition is crucial to Thm. 1; mutual weak inference can occur 
between non-distinguishable devices. 

Example 5: Consider a rectangular grid of particle pairs, each pair consisting of a yellow particle 
and a purple particle. Say that all particles can either be spin up or spin down. Write the spin of 
the purple particle at grid location (i, j) as s^ii, j), and the spin of the yellow particle there as 

Such a grid is a set U consisting of all quadruples {i, j, sP{i, j), s^(i, j)}. Assume there are 
at least two i values, and at least one purple spin is up and at least one is down. Then we can 
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define a "purple inference device" C by X^ii, j, «''(/, j), s^'(i, j)) = / and YP(i, j, s''(i, j), j)) = 
s''(i, j). Similarly, a "yellow inference device" can be defined by j, s''{i, j), j)) = j and 
P (i, _/', s'\i, j), S''{i, j)) = S''{i, j) (assuming there are at least two /s and at least one yellow 
particle is spin up and at least one is spin down). 

These two devices are distinguishable. In addition, C > C if there is some /' such that 
s''{i',j) - s^\i',j) for all j, and also some /" such that s''(i",j) - -s^'{i",j) for all j. In such 
a situation we can set up the purple device with a value (i') that guarantees that its conclusion 
correctly answers the question, "Does s^' point up?". Similarly, we can set it up with a value that 
guarantees that its conclusion correctly answers the question, "Does point down?". 

However if there is such an /' and /", then clearly there cannot also be both a value / and a 
value /' that the yellow inference device can use to answer whether points up and whether 
s'' points down, respectively. This impossibility holds regardless of the size of the grid and the 
particular pattern of yellow and purple particles on the grid. Thm. 1 generalizes this impossibility 
result. 

As a general comment, the definition of what it means for a device to infer F can be re- 
expressed in terms of the pre-images in U of F, {F"' (y) : y e F(f/)}[f] Now in this paper we only 
consider weak inference of F's that are functions. So none of those pre-images of F intersect 
the others; they comprise a partition of U. However more generally, one might be interested in 
inference of F when some of the pre-images of F have non-empty intersection with one another. 
For example, one might wish to observe if some physical variable is in the range [0, 10], the 
range [5,20], or the range [15,30]. Formally, the generalization to overlapping pre-images of 
F arises by allowing F to be a correspondence rather than a function. The generalization of the 
formalism to explicitly accommodate such correspondences is beyond the scope of this paper. 
Note though that since devices are pairs of functions, that generalization is not relevant for much 
of the analysis concerning the inference of one device by another. 

4. Turing machines, Universal Turing machines, and inference 

There are several connections between inference and results in computer science f49]. In this 
section we introduce some elementary concepts for exploring those connections. 

4. 1 . Turing machines and inference 

Consider a deterministic Turing Machine (TM) and write its internal state at iteration t as g{t), 
with the state of its tape then being written as hit). So the operation of the TM on a particular 
initial value of its tape h{tQ) produces an infinite sequence {h{tQ), g(to), h(to + 1), g(tQ + 1), . . .]. (If 
g{t) is the halt state, then for completeness we define g(t') = g(t),h{t') - h{t) Vf' > t.) Which 
such sequence the TM executes is determined by the value h(tQ) (assuming a default value for 

Next take U to be the set of worldlines consistent with the laws of physics in our universe (and 
no other worldlines). Hypothesize that it is consistent with those laws of physics to have some 
particular TM T be physically instantiated in our universe, with iteration number t corresponding 
to time in some particular reference frame. Then which sequence T actually executes can be 



Writing it out, if C infers T, then for all V y e V(U),3xeX(U) such that [X^'W n F-'(l)] = [X"' W n r-'(r)]- 
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cast as a projection function of the worldline u e U. (Recall that worldlines extend across all 
time.) Accordingly we can identify any T as a function F with domain U. The set of all possible 
sequences of T that can occur in our universe is simply a set of functions F. 

To be more precise, fix fo, and let be the set of all possible initial (time to) values of 
r's tape. Define as the map by which T takes h(to) e to the associated infinite sequence 
{h{to), g(to), h{to+l), g(to + 1), . . .}. can be viewed as defining T. Equivalently, we can express 
r as a function over U, F^: F^ projects every m e f/ in which T has initial tape state h € to 
M^(h). and F^ have the same range (namely the set of all sequences that T can generate), 
but different domains {H^ and U, respectively). 

Now construct an inference device = {X^ ,Y^) where X^(U) = {(h,f ) : h E H^,f € 
n{T^)}. Write the two components of any value X^(u) as Xj^iu) and Xj(u), where XJ(m) is defined 
to be the value /i(fo) for the TM T when the worldline is u. So X^ "initializes" the TM. Note that 
the second component of X, Xj, maps u onto a space of functions over U (namely, the space 
<F)). Finally, define : u ^ I Xj (u)[M^ (Xj^ (u))] = 1. 

If X^ is set up to be a particular initial state of T's tape, together with a particular probe 
concerning the resultant sequence of internal and tape states, then for any u the conclusion Y^(u) 
is the actual value of that probe for the sequence of internal and tape states specified in u. Since 
probes are simply a way to imbue the conclusion of the device with semantic meaning (recall Ex. 
3 in Sec. |2]i, this means we can view C as equivalent to T. In particular, infers the TM, i.e., 
> F^. 

We can generalize this example, to identify inference devices in general as analogs of TM's, 
with inference being the analog of TM-style computation. All of the impossibility results pre- 
sented above apply to these analogs of TM's. To illustrate this. Prop. l(ii) can be taken to mean 
that for any such inference-based analog of a TM, there is some function that the device can- 
not "compute". In particular, this is true for the device that essentially equals the TM T. In 
this. Prop. l(ii) can be viewed as the analog for inference devices of the Halting theorem, which 
concerns TM's. Moreover, this reasoning concerning physical realizations of TM's applies just 
as well to other members of the Chomsky hierarchy besides TM's, providing us with "halting 
theorems" for those other members. 

As a final comment on the relation between inference and TM-style computation, note that 
inference by a device C is not a form of counter-factual "computation". Inference by C does not 
compute the answer to a question of the form "If {axioms) then {implications}", unless there is 
some X such that "{axioms}" actually holds for all u e U that C induces by setting X(u) - x. In 
particular, if in our universe there is no physical instantiation of some particular TM, then there 
is no device in our universe whose inference is computationally equivalent to that TM. 



4.2. Universal Turing machines and inference 

Now we investigate how to define an analog of Universal Turing Machines (UTM's) for in- 
ference devices. More precisely, we consider how to define what it means for one device Ci to 
emulate the inference process of another device C2. (Just like a UTM emulates the computational 
process of another TM.) One natural desideratum for such a definition is that for Ci to "emu- 
late" C2 implies, at a minimum, that Ci > €2- So for example, if the two devices are both being 
used for prediction, this would mean that Ci can correctly predict what prediction C2 will make 
(whether or not that prediction by C2 is itself correct). 
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However we want Ci able to do more than infer the value of Y2(u); we want C\ able to emulate 
the entire mapping taking any X2 to the associated value(s) F2(-^2 '^■^2))- We want Ci able to infer 
what inference C2 might make for any setup value X2, not just the inference that C2 makes for 
the members of a set X2[X^^{xi)] picked out by some particular xi . This means that all X2's must 
be allowed. 

One way to formalize this second desideratum is to require that Ci can infer C2 using a setup 
value that forces a unique X2, and can do so for any desired X2. More precisely, consider a par- 
ticular case where we want Ci to emulate the inference performed by C2 when X2iu) - X2. We 
can do this if Ci infers Y2, while the value xi used in that inference guarantees that X2{u) = X2. 
That guarantee means that Ci infers the conclusion of C2 when C2 has the setup value X2. Given 
this interpretation of what it means for Ci to emulate C2 when X2iu) = X2, to have Ci emulate 
C2 in full simply means that we require that such emulation be possible for any X2 e X2{U). So 
formally, we require that V/ e n{Y2), Vx2, 3x\ such that X\ - xi ^ X2 - X2, Yi - f(Y2). 

A second formalization takes the opposite approach, and stipulates that the value xi used by Ci 
to infer C2 places no restrictions on X2 whatsoever. Formally, this means that V/ € 7:{Y2), Vx2, 3xi 
such that nXj'fe) 0andXi = xi ^ Fi = /(F2)- 

In analogy with UTM's, one might say that under the first formalization Ci specifies the "input 
tape" to C2 for which Ci will emulate C2, and then successfully carries out that emulation, i.e., 
successfully "computes" what C2 will produce in response to that input tape. To do this though 
C\ must interfere with C2, forcing it to have that desired input tape. In contrast, under the second 
formalization, there is no requirement that X[ force a particular value of X2. In particular, the 
second formalization is obeyed if V/ e n{Y2), 3xi such that X[ = X[ ^ Yi - /(i'2) while at the 
same time X^^{xi) n '(X2) Vx2. In such a situation, Ci can emulate C2 using an xi that 
doesn't reflect how C2 is set up. (Physically, this usually requires that the system underlying Ci 
must be coupled with the system underlying C2 at some time, so that X2 can be made known to 
Ci.) 

Despite this apparent difference, these two formalizations of our second desideratum reflect 
the same underlying mathematical structure. To see this, define a composite device C = {X', Y') 
where X' : u — » {X[(u),X2(u))andY' = Fi . Then under our second formalization of "emulation", 
for Ci to emulate C2 implies that V/ e 7t(Y2),'^X2,3x' such that X''\x') n X2\x2) + and 
X' ^ x' ^ X2 ^ X2,Y' = f(Y2). However X'-\x') n X2UX2) + means that X' ^ x' ^ 
X2 - XT,, by definition of X' . So this second formalization of what it means for C\ to emulate C2 
stipulates a relation between C and C2 that is identical to the relation between C\ and C2 under 
the first formalization. In this sense, our second formalization reduces to our first. Accordingly, 
we concentrate on the first formalization, and make the following definition: 

Definition 5: A device (X\,Y\) strongly infers a device (X2, Y2) iff'ife 7r(F2) and all X2, 3 xi 

such that Xi - Xy ^ X2 - X2, Yy - f(Y2). 

If (Xi, Yi) strongly infers (X2, Y2) we write (Xu Yi) » (X2, F2)[Z]See App. B for a discussion of 
how minimal the definition of strong inference really is. 

Say we have a TM Ti that can emulate another TM T2, e.g., Ti is a UTM. This means that Ti 
can calculate anything that T2 can. The analogous property holds for strong and weak inference. 



' Note that there are only two probes of Y2, the identity probe /(>'2) = y2 and the negation probe, f(y2) = -yi- Indicate 
those two probes by / = 1 and / = - 1 , respectively. Then we can express Xi = X| => X2 = X2, Y\ = fij^) in set-theoretic 
terms, as cX^'te) n (fi y2)"'(/), where YxY^ is the function i; e {/ ^ Yx(u)Y2(u). 
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In addition, like UTM-style emulation (but unlike weak inference), strong inference is transitive. 
These results are formalized as follows: 

Theorem 2: Let Ci, C2 and C3 be a set of inference devices over U and T a function over U. 
Then: 

i) Ci » C2 and C2 > T Ci > T. 

ii) Ci » C2 and C2 » C3 ^ Ci » C3. 

Strong inference implies weak inference, i.e., Ci » C2 Ci > C2. We also have the follow- 
ing strong inference analogs of Prop. l(ii) and Coroll. 1 (which concerns weak inference): 

Proposition 2: Let C\ be a device over U. 

i) There is a device C2 such that C\ ^ C^. 

ii) Say that V jci, |Xj"'(jici)| > 2. Then there is a device C2 such that C2 » Ci. 

Recall that the Halting problem concerns whether there is a UTM T with the following prop- 
erty: Given any TM T and associated input string s' , if T and s' are encoded as an input string 
to r, then r always correctly decides whether T halts on input s' . The Halting theorem then 
says that there can be no such UTM T . Intuitively, Prop. 2(i) can be viewed as an analog of this 
theorem, in the context of inference. (See also Prop. 7 below.) 

In general we are not interested in whether a device can strongly infer an arbitrary set of other 
devices, but rather with the strong inference relationships among the members of a particular 
set of devices. Just like with weak inference, no device can strongly infer itself. This can be 
generalized to concern a set of multiple devices as follows: 

Theorem 3: No two devices can strongly infer each other. 

Note that Thm. 3 does not require distinguishability, in contrast to Thm. 1 . 

5. Inference Complexity 

In computer science, given a TM T, the Kolmogorov complexity of an output string s is defined 
as the length of the smallest input string s' that when input to T produces s as output. To construct 
our inference device analog of this, we need to define the "length" of an input region of an 
inference device C. To do this, we assume we are given a measure c/yu over JJ , and for simplicity 
restrict attention to functions G over JJ with countable range. Then we define the length of 
g 6 G(f/) as -ln[J d[i G"'(g)], i.e., the negative logarithm of the volume of all m € f/ such that 
G(m) - g. We write this length as Ji'dg), or just ^(g) for short[3 

Definition 6: Let C be a device and F a function over U where X(U) and r{U) are countable and 
C > r. The inference complexity of T with respect to C is defined as 



If J d/i 1 = 00, then we instead work with differences in logarithms of volumes, evaluated under an appropriate limit 
of d^l that takes j dfi I ^ oo. For example, we might work with such differences when U is taken to be a box whose size 
goes to infinity. This is just the usual physics trick for deahng with infinite volumes. 
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^(r \C) ^ Yj ^^r.X=.^Y=f(r)[^ix)]. 



The inference complexity of T with respect to C is the sum of a set of "complexities", one 
for each probe of F, /. Loosely speaking, each of those complexities is the minimal amount 
of Shannon information that must be imposed in C's setup function in order to ensure that C 
correctly concludes what value / has. In particular, if F corresponds to a potential future state of 
some system S external to C, then ^(F | C) is a measure of how difficult it is for C to predict 
that future state of S . Loosely speaking, the more sensitively that future state depends on current 
conditions, the more complex is the computation of that future state. 

Example 6: Consider a conventional real- world computer, with a subsection of its RAM set aside 
to contain the program it will run, and a separate subsection set aside to contain the conclusion 
that the program will produce. Say the total number of bits in the program subsection of the 
RAM is 2*^ + A: for some integer k. Refer to any set of 2* + A: bits as a "complete string"; the set of 
all complete strings is the set of all possible bit strings in the program subsection of the RAM. 

Let YI^ be the set of all bit strings s consisting of at least k bits such that the first k bits are a 
binary encoding of the total number of bits in s beyond those first k bits. So every element of 

can be read into the beginning of the RAM's program subsection. For any s € define an 
associated "partial string" as the set of all complete strings whose first bits are s. Intuitively, for 
any such complete string, all of its bits beyond s are "wild cards". (Such partial strings are just 
the "files" of real-world operating systems.) With some abuse of terminology, when we write "i" 
we will sometimes actually mean the partial string that s specifies. 

We can identify a particular program input to the computer as such a partial string in its pro- 
gram subsection. If we append certain bits to such an s (modifying the contents of the first k bits 
appropriately) to get a new longer program partial string, s' , the set of complete strings consistent 
with s' is a proper subset of the set of complete strings consistent with s. 

Define the length of a partial string s as the negative of the logarithm of the number of complete 
strings that have s at their begiiming, minus k. This matches the usual definition of the length of a 
string used in computer science. In particular, if s' contains n more bits than does s, then there are 
2n times as many complete strings consistent with s as there are consistent with s' . Accordingly, 
if we take logarithms to have base 2, the length of s' equals the length of s, plus n. 

Now view our physical computer as an inference device, with U the Cartesian product of the 
set of all possible bit strings in the RAM of the computer together with some countable-valued 
variables concerning the world outside of the computer. Refer to the components of any u € U 
specifying the bit string in the program subsection of the RAM as the "program subsection of u", 
and similarly for the "conclusion subsection of m". 

For the computer to be an inference device means that the conclusion subsection of u consists 
of a single bit, i.e., Y maps all m e U to the (bit) value of the conclusion subsection of the 
computer's RAM as specified by u. For all u € U, have X{u) be the bit string at the beginning of 
the program subsection of u whose length is given by the first k bits of that program subsection 
of u. So X is a partial string of the RAM's program subsection. In general, there are many sets 
each consisting of multiple u e U that have the same image under X, i.e., there are many x such 
thatZ"'(x) consists of multiple elements. If we adopt the uniform point measure dji, then ^{x) 
is just the negative logarithm of the number of such elements in X"'(x), i.e., the length of the 
partial string x in the program subsection of the computer's RAM. 

Now say we want our computer to make a prediction concerning the value of T{U), one of 
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the variables associated with the world outside of the computer As usual, we interpret this to 
mean that for any y E r(U), there is some partial string we can read into the computer's program 
subsection that contains enough information concerning F and the state of the world so that the 
computer's conclusion will correctly say whether r(u) = y. The inference complexity of that 
prediction of F is the sum, over all such probes / of F, of the length of the shortest partial string 
in the computer's program subsection that cause it to correctly conclude the value of /. 

The min over x's in Def. 6 is a direct analog of the min in the definition of Kolmogorov 
complexity (there the min is over those strings that when input to a particular UTM result in the 
desired output string). A natural modification to Def. 6 is to remove the min by considering all 
^'s that cause Y = /(F), not just of one of them: 



/e^(r) 



fen(r) lx:X=x^Y=f(r) 



where the equality follows from the fact that for any x,x' + x, X^^{x) n X^^{x') - 0. The 
argument of the In in this modified version of inference complexity has a direct analog in TM 
theory: The sum, over all input strings s to a UTM that generate a desired output string i', of 
2-"(s)^ where n(s) is the bit length of s. 

We now bound how much more complex a function can appear to C\ than to C2 if C\ can 
strongly infer C2. 

Theorem 4: Let C\ and C2 be two devices and F a function over U where F(J7) is finite, C\ » C2, 
and C2 > F. Then 



^(F I Ci) - ^(F I C2) < |F(f/)| max,,min„:x,=.,^x,=..,r,=y,mxi) - ^(x2)]. 



Note that since ^(x\)- ^{xi) - ln[^^^], the bound in Thm. 4 is independent of the units with 
which one measures volume in U . (Cf. footnote [8]) Furthermore, recall that X\ - x\ ^ X2 - 
XI, Yi = Y2 ifiX-\x-i) c ^2 1(^2) n (7iy2)"'(l)- (Cf. footnote|71) Accordingly, for all (xi,X2) 

pairs arising in the bound in Thm. 4, ^4^^ > 1. So the bound in Thm. 4 is always non-negative. 

An important result in the theory of UTM's is an upper bound on the difference between the 
Kolmogorov complexity of a string using a particular UTM T\ and its complexity if using a 
diff'erent UTM, T2. This bound is independent of the computation to be performed, and can be 
viewed as the Kolmogorov complexity of T\ emulating T2- 

The bound in Thm. 4 is the analog of this UTM result, for inference devices. In particular, the 
bound in Thm. 4 is independent of all aspects of F except the cardinality of T{U). Intuitively, 
the bound is |F(t/)| times the worst-case amount of "computational work" that C\ has to do to 
"emulate" C2's behavior for some particular value of X2. 
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6. Realities and copies of devices 

In this section the discussion is broadened to allow sets of many functions to be inferred and 
/ or inference devices. Some of the philosophical implications of the ensuing results are then 
discussed. 

6.1. Formal results 

To analyze relationships among multiple devices and functions, define a reality as a pair 
(U; {F^]) where U is a space and [F^] is a (perhaps uncountable) non-empty set of functions 
all having domain U. We will sometimes say that U is the domain of the reality. We are par- 
ticularly interested in device realities in which some of the functions are binary-valued, and we 
wish to pair each of those functions uniquely with some of the other functions. Such realities can 
be written as the triple (U; {(Xa, [rp]) = (U; {€„]', {rg}) where {Ca] is a set of devices over 
U and {Fp] a set of functions over U. 

Define a universal device as any device in a reality that can strongly infer all other devices 
and weakly infer all functions in that reality. Thm. 3 means that no reality can contain more than 
one universal device. So in particular, if a reality contains at least one universal device, then it has 
a unique natural choice for an inference complexity measure, namely the inference complexity 
with respect to its (unique) universal device. (This contrasts with Kolmogorov complexity, which 
depends on the arbitrary choice of what UTM to use.) 

It is useful to define the reduced form of a reaUty (U ; {F^}) as the range of F^. Expanding, 
this equals U„gf/[X0 F^](u), the union over all u of the tuples formed by a Cartesian product, 
running over all (p, of the values F^(u). In particular, the reduced form of a device reality is the 
set of all tuples ([xi,yi], [x2,y2], • • • ;7i,T2, • • •) for which 3 u & U such that simultaneously 
Xi(u) = xi, Yi(u) = yi,X2(u) = X2, Y2(u) = y2,.. .■,Ti(u) = 'Yi,T2(u) = yi, • • •• 

As an example, take U to be the set of all worldlines consistent with the laws of physics (and 
no other worldlines). So for example, if one wants to consider a universe in which the laws of 
physics are time-reversible and deterministic, then we require that no two distinct members of 
U can intersect. Similarly, properties like time-translation invariance can be imposed on U, as 
can more elaborate laws involving physical constants. Which such particular properties of U are 
imposed depends on what the laws of physics are. 

Next, have {Fyj) be a set of physical characteristics of the universe, each characteristic perhaps 
defined in terms of the values of one or more physical variables at multiple locations and/or 
multiple times. Finally, have {Ca] be all prediction / observation systems concerning the universe 
that aU scientists might ever be involved in. 

This example is the conventional way to interpret our universe as a reaUty. In this example the 
laws of physics are embodied in U. The implications of those laws for the relationships among the 
scientist devices {Ca} and the other characteristics of the universe {Tp] is embodied in the reduced 
form of the reaUty. Viewing the universe this way, it is the u € U, specifying the universe's state 
for all time, that has "physical meaning". The reduced form instead is a logical implication of the 
laws of the universe. In particular, our universe's u picks out the tuple [Xa Caiu)] X [X^ ^piu)] 
from the reduced form of the reaUty. 

As an alternative we can view the reduced form of the reaUty as encapsulating the "physical 
meaning" of the universe. In this alternative u does not have any physical meaning. It is only 
the relationships among the inferences about u that one might want to make and the devices 
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with which to try to make those inferences that has physical meaning. One could completely 
change the space U and the functions defined over it, but if the associated reduced form of the 
reality does not change, then there is no way that the devices in that reality, when considering 
the functions in that reahty, can tell that they are now defined over a different U. In this view, the 
laws of physics i.e., a choice for the set U, are simply a calculational shortcut for encapsulating 
patterns in the reduced form of the reality. It is a particular instantiation of those patterns that has 
physical meaning, not some particular element u € U. 

Given a reality (U; {(X\, Yi), (X2, Y2), . . .)), we say that a pair of devices in it are pairwise 
distinguishable if they are distinguishable. We say that a device (X,, Yf) in that reality is outside 
distinguishable iff V x,- e and all x'_i in the range of ^j^^Xj, there is a m e f/ such 

that simultaneously X,(m) = x,- and Xj(u) - x'j V/ /. (Note that that range may be a proper 
subset of X;#i Xj(U).) We say that the reahty as a whole is mutually (setup) distinguishable iff 
V xi e Xi(f/),X2 e X2iU), ... 3u€U s.t. Xi{u) = xi,X2(m) = xi, . . .. 

Proposition 3: 

i) There exist realities (U; Ci, C2, C3) where each pair of devices is setup distinguishable 
andCi > C2 > C3 > Ci. 

ii) There exists no reality (U; {Ci : i e J/ c N}) where the devices are mutually 
distinguishable and for some integer n,C\ > C2 >■■■>€„> C\. 

iii) There exists no reahty (f/; {C,- : j e ^ c N}) where for some integer n, Ci » C2 » 
... » C„ » Ci. 

Consider a reality with a countable set of devices {C,). There are many ways to view such 
a reality as a graph, for example by having each node be a device while the edges between 
the nodes concern distinguishabiUty of the associated devices, or concern whether one weakly 
infers the other, etc. There are restrictions on what graphs of those various sorts can exist. As an 
example, given a countable reality, define an associated directed graph by identifying each device 
with a separate node in the graph, and by identifying each relationship of the form C, » Cj with 
a directed edge going from node i to node j. We call this the strong inference graph of the 
reality. 

Thm. 3 means that a universal device in a reahty must be a root node of the strong inference 
graph of the reality. Applying Th. 3 again shows that the strong inference graph of a reality with 
a universal device must contain exactly one root. In addition, by Thm. 2(ii), we know that every 
node in a reality's strong inference graph has edges that lead directly to every one of its successor 
nodes (whether or not there is a universal device in the reahty). By Prop. 3(iii) we also know that 
a reality's strong inference graph is acyclic. This latter fact establishes the following: 

Proposition 4: Let D be a finite subset of the devices in a reality, where the strong inference 
graph of the reality is weakly connected over D. Say that any pair of distinct devices in D that 
are not connected by an edge of the strong inference graph are setup distinguishable. 
Then the strong inference graph of the reality has one and only one root over D. 

Results of this sort mean there are unavoidable asymmetries in the strong inference graphs of 
realities. These asymmetries provide a preferred direction of strong inference in reahties, akin to 
the preferred direction in time provided by the second law of thermodynamics. 

Note that even if a device Ci can strongly infer all other devices C,>i in a reality, it may 
not be able to infer them simultaneously (strongly or weakly). For example, define F : m — > 
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(Y2(u), Y^iu), . . .)• Then the fact that Ci is a universal device does not mean that V/ e 7r(r) 3 xi : 
Yi - /(r). See the discussion in [26] on "omniscient devices" for more on this point. 
We now define what it means for two devices to operate in an identical manner: 

Definition 7: Let U and U be two (perhaps identical) sets. Let Ci be a device in a reality with 
domain U. Let 7? i be the relation between Xi and Yi specified by the reduced form of that reality, 
i.e., xiR\yi iff the pair (xi,3;i) occurs in some tuple in the reduced form of the reality. Similarly 
let R2 be the relation between X2 and Y2 for some separate device C2 in the reduced form of a 
reality having domain U. 

Then we say that Ci mimics C2 iff there is an injection, px : X2{U) —> Xi{U) and a bijection 
Py '■ Y2(U) Yi{U), such that for 'ix2,y2, X2R2y2 Px{x2)RiPY{y2)- If both Ci mimics C2 and 
vice-versa, we say that Ci and C2 are copies of each other. 

Note that because px in Def. 7 may not be surjective, one device may mimic multiple other 
devices. (Surjectivity of py simply reflects the fact that since we're considering devices, Yi(U) - 
Y2(U) = B.) The relation of one device mimicing another is reflexive and transitive. The relation 
of two devices being copies is an equivalence relation. 

Intuitively, when expressed as devices, two physical systems are copies if they follow the 
same inference algorithm with px and py translating between those systems. In particular, say a 
reality contains two separate physical computers that are inference devices, both being used for 
prediction. If those devices are copies of each other, then they form the same conclusion for the 
same value of their setup function, i.e., they perform the same computation for the same input. 

As another example, say that the states of some physical system 5 at a particular time f and 
shortly thereafter att + 6 are identified as the setup and conclusion values of a device Ci . In other 
words, Ci is given by the functions {Xi{u), Yi{u)) = {S(u,),S(u,+s)). In addition, let Rs be the 
relation between Xi and Yi specified by the reduced form of the reality containing the system. 
Say that the time-translation of Ci , given by the two functions S iut') and S {u,'+s), also obeys the 
relation Rs - Then the pair of functions {X2{u), Y2{u)) = (S{uit),S{u,i+s)) is another device that 
is copy of C\ . So for example, the same physical computer at two separate pairs of moments is 
two separate devices, devices that are copies of each other, assuming they have the same set of 
allowed computations. 

Say that an inference device C2 is being used for observation and C\ mimics C2. The fact that 
C\ mimics C2 does not imply that C\ can emulate the observation that C2 makes of some outside 
function F. The mimicry property only relates C\ and C2, with no concern for third relationships 
with any third function. (This is why for one device to "emulate" another is defined in terms of 
strong inference rather than in terms of mimicry.) 

Next for future use we note the following fact that is almost obvious (despite being so compli- 
cated): 

Lemma 1: Let Ki be the set of reduced forms of all device realities. Let K2 be the set of all 
sets k with the following property: k can be written as {{yiaes^i^a^^a) ^ X/se,® t^'p : r e R) 
for some associated jz/, ^ and R such that for all a, U,.f^ = B and | U,. s''J\ > 2, while for all 
yS e I U,- v^l > 2. Then K\ - K2. In particular, any e is the reduced form of a reality 
(f/; {Cq,}, {F/j)), where for all a e ^,y6 e m e U, there is some associated r e R such that 
simultaneously Xdu) - sj^, Fq.(m) — t'^, and F^(m) - vjj. 

Next, fix a counting number m and a set of m cardinalities, {O, : / = 1, . . .m). Let M be the set 
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of all realities each of which comprises m functions, where the ranges of those m functions have 
the associated cardinalities |Q, :/=!,... m]. 

Now say we ask whether there is a reality in M whose m functions have some particular rela- 
tionship(s) with one another. (Answers to such questions form most of the results of the earlier 
parts of this paper) Lemma 1 allows us to transform this question into a constraint satisfac- 
tion problem over an associated space of tuples. This transformation changes set of "specified 
relationship(s)" into a set of simultaneous constraints over the associated space of tuples. The 
precise type of constraint satisfaction problem produced by the transformation (integer-valued, 
real-valued, etc.) is determined by the space of tuples under consideration, i.e., by the cardinali- 
ties of the images of the functions that constitute the reality. 

Often though we can use Lemma 1 more directly to answer questions concerning realities, 
without invoking any techniques for solving constraint satisfaction problems. An example occurs 
in the proof of the following result: 

Proposition 5: Let Ci be a copy of C2. 

i) It is possible that Ci and C2 are distinguishable and Ci > C2, even for finite Xi{U),X2{U). 

ii) It is possible that Ci » C2, but only if Xi(U) and X2{U) are both infinite. 

6.2. Philosophical implications 

Return now to the case where f/ is a set of laws of physics (i.e., the set of all worldlines consis- 
tent with a set of such laws). The results of this subsection provide general restrictions that must 
relate any devices in such a universe, regardless of the detailed nature of the laws of that universe. 
In particular, these results would have to be obeyed by all universes in a multiverse 1271281291 . 

Accordingly, it is interesting to consider these results from an informal philosophical perspec- 
tive. Say we have a device C in a reaUty that is outside distinguishable. Such a device can be 
viewed as having "free will", in that the way the other devices are set up does not restrict how 
C can be set up. Under this interpretation, Thm. 1 means that if two devices both have free will, 
then they cannot predict / recall / observe each other with guaranteed complete accuracy. A real- 
ity can have at most one of its devices that has free will and can predict / recall / observe the other 
devices in that reality with guaranteed complete accuracy. (Similar conclusions hold for whether 
the devices can "control" each other; see Sec.|2]below.) 

Thm. 3 then goes further and considers devices that can emulate each other It shows that 
independent of concerns of free will, no two devices can unerringly emulate each other (In other 
words, no reality can have more than one universal device.) Somewhat tongue in cheek, taken 
together, these results could be called a "monotheism theorem". 

Now suppose that the domain of a reality is a set of worldlines extending across time, and 
consider "physical" devices that are identified with systems evolving in time. (See discussion 
just after Def. 7.) Prop. 5 tells us that any universal device must be infinite (have infinite X{U)) if 
there are other devices in the reality that are copies of it. Since the time-translation of a physical 
device is a copy of that device, this means any physical device that is ever universal must be 
infinite. In addition, the impossibility of multiple universal devices in a reality means that if any 
physical device is universal, it can only be so at one moment in time. (Its time-translation cannot 
be universal.) Again somewhat tongue in cheek, taken together this second set of results could 
be called an "intelligent design theorem". (See Sec.|7]for related Umitations concerning devices 
that are used to control one another.) 
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In addition to the questions addressed by the monotheism and intelligent design theorems, 
there are many other semi-philosophical questions one can ask of the form "Can there be a 
reality with the following properties?". As mentioned above, Lemma 1 can be used to reduce 
all such questions to a constraint satisfaction problem, potentially involving infinite-dimensional 
spaces. In other words, much of philosophy can be reduced to constraint satisfaction problems. 

As a final comment, while it is most straight-forward to apply the results of this subsection 
to physical universes, they can be applied more widely. In particular, somewhat speculatively, 
one can consider applying them to mathematical logic itself. In such an application each u e U 
would be a (perhaps infinite) string over some alphabet. For example, U might be defined as 
the set of all strings that are "true" under some encoding that translates a string into axioms and 
associated logical implications. Then an inference device would be a (perhaps fallible) theorem- 
proving algorithm, embodied within U itself. The results of this subsection would then concern 
the relation among such theorem-proving algorithms. 

7. Control devices 

In weak inference there is no causal arrow from F to X. In fact, the only causal arrow goes 
from the device to the function being inferred (in that X's value forces something about F's value) 
rather than vice-versa. This reflects what it means for us to be able to set up a device so that it is 
guaranteed correct in its prediction / observation/ memory. 

This causal arrow from the device to the function does not mean that the device controls the 
function. The reason is that X's value doesn't set F's value, but only forces that value to be 
consistent with Y. This motivates the following definition: 

Deflnition 8: A device C controls a function F over U iSS f e 7r(F), e B, 3x such that 
X^x^Y ^ /(F) ^b.C semi-controls F iff Vy e F(f/), 3 x such that X = x ^ F = y. 

Semi-control has nothing to do with the conclusion function Y of the device; that function 
enters when one strengthens the definition of semi-control to get the definition of control. To see 
this, note that C semi-controls F iff V / 6 7r(F), 3x such that X - x ^ /(F) - 1 . However if 
X = X forces /(F) = 1, then for any probe /' f, X - x forces /'(F) = 0. So C semi-controls 
F iff" V / e 7r(F), Sb e B, 3x such that X - x ^ /(F) - b. This is just the definition of control, 
without the extra condition that controls imposes on the value of Y. We say that one device C 
(semi-) controls another if it (semi-) controls the conclusion function of that second device. 

The weakness of the semi-control concept is that it stipulates nothing concerning whether C 
"knows" (infers) that some value x forces F into the state f^^{b). In this, it doesn't capture the 
intuitive notion of "control". Accordingly, in the formalization of Def. 8, we stipulate that you 
do not fully control a function if you force it to have some value but don't know what that value 
is. 

If the partition induced by X is a refinement of the partition induced by F |50|, and in particular 
if it is a fine-graining of that partition, then C semi-controls F. Note also that if F is binary-valued, 
then having C semi-control F means there is both an x such that X{u) = x => m e F '(1) and an 
x' such that X(u) - x' ^ u e F"'(-l). In the language of formal epistemology [ 42143 145 144L 
this means that X '(x) and X '(jc') are the values of a "knowledge function" evaluated for two 
arguments: the subset F"'(l) and the subset F"'(-l), respectively. (See Sec. |9]below.) 

Clearly control implies semi-control. In addition, if one device C\ strongly infers another 
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device C2, then Ci semi-controls X2, though it may not semi-control ¥2- Control implies weak 
inference, i.e., if C\ controls a function F then C\ > F. The logical converse need not hold though. 

Since control implies weak inference, all impossibility results concerning weak inference also 
apply to control. In particular, no device can control itself, and no two distinguishable devices 
can control each other. In fact we can make the following stronger statement, which essentially 
states that if two partitions are refinements of each another, they must be identical: 

Theorem 5: If two devices Ci and C2 simultaneously semi-control one another's setup functions, 
then the partitions induced by Xi and X2 are identical. 

Intuitively, Thm. 5 means that if two devices simultaneously semi-control one another's setup 
functions, then those setup functions are identical, up to a relabeling of their ranges. This provides 
the following results contrasting with Thm. 1 and Thm. 3: 

Corollary 3: Let Ci and C2 be two devices that simultaneously semi-control one another's setup 
functions. 

i) Ci > C2 o C2 > Ci. 

ii) Neither device strongly infers the other 

iii) Neither device controls the other's setup function. 



8. Stochastic devices 

In the analysis above there is no probability measure P over U. There are several ways to 
extend the analysis to incorporate such a probability measure, so that functions over U become 
random variables. One starts as follows: 

Definition 9: Let P(u e f/) be a probability measure, F a function with domain U and finite 
range, and e E [0.0, LO]. Then we say that a device (X, Y) (weakly) infers F with (covariance) 
accuracy e iff 

Y^f^^^r) max,[Ef (y/(r) | x)] _ 

mu)\ 

As an example, if P is nowhere and C weakly infers F, then C infers F with accuracy LOH 

There are several reasonable alternatives to this definition. As an example, recall the "mali- 
cious demon" interpretation of / introduced just below Def. 3. That interpretation suggests a 
change to Def. 9 in which we replace the sum over all probes / and associated division by |F(f/)| 
with a minimum over all probes /. 

Note though that it does not seem reasonable to define inference accuracy in terms of mutual 
information expressions like M(y, /(F) | X = x). To see why consider the case where / is a 
probe of F that equals 1 iff F = y, and let x be a value where X - x ^ Y = -/(F). In this case 
the mutual information conditioned on x between Y and /(F) would be maximal. However the 

' A subtlety with the definition of an inference devices arises in this stochastic setting: we can either require that Y be 
surjective, as in Def. 1, or instead require that Y be stochastically surjective: Vy e B, 3u with non-zero probability 
density such that Y{u) = y. The distinction between requiring surjectivity and stochastic surjectivity of Y will not arise 
here. 
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device would have probability zero of correctly answering the question, "does T have value y?". 
It would either say "yes" and in fact F does not equal y, or it would say "no" and in fact F does 
equal y. 

This is an illustration of the fact that the definition of inference assigns semantic content to 
Y - 1: it means that the device's answer is "yes". In contrast, information theoretic quantities 
like mutual information are (in)famous for not involving semantic content. 

While inference is a semantic concept, distinguishability is not, which motivates the following 
definition: 

Deftnition 10: Let P(u e U)he a probability measure, and e e [0.0, 1.0]. Then we say that the 
(setup) mutual information-distinguishability of two device (Xi, Fi) and (Xi, Fi) is 

^ Mp(XuX2) 

Hp(Xi) + mp(X2) ' 

Mutual-information distinguishability is bounded between and 1 . 

Note that variables can be distinguishable in the sense of Def . 4 even if their mutual informa- 
tion distinguishabihty is less than 1. (They can be partially correlated but still distinguishable in 
the sense of Def. 4.) This motivates the following alternative definition, for simpUcity phrased 
for countable X{Uy. 

Definition 11: Let P(u e J/) be a probability measure, and e e [0.0, 1.0]. Then we say that the 
counting distinguishability of two device (Xi, Fi) and (X2, F2) is 

|Xi(f/)|x|X2(t/)| 

There are many analogs of Thm. 1 that relate quantities like the accuracy with which device 
Ci infers device C2, the accuracy with which C2 infers C\ , how distinguishable they are, the 
entropies of the random variables Xi and X2, etc. To present perhaps the simplest such example, 
define H as the four-dimensional hypercube {0, 1))'*, k(z) as the map taking any z & H to z\ + 
Zi-zi- Z3, m{z) as the map taking any z g to (z2 - za), and n{z) as the map taking any z e // 

to (Z3 - Za)- 

Proposition 6: Let F be a probability measure over U, and C\ and C2 two devices whose mutual- 
information distinguishabihty is 1, where X\{U) = XiiU) = B. Define P{Xi = -1) = a and 
PiX2 = -1) = yS. Say that C\ infers C2 with accuracy e\, while C2 infers C2 with accuracy £2- 
Then 

6162 < maxje/f I afi[kiz)f + ak{z)m{z) + pk{z)n{z) + m{z)n{z) \. 
In particular, if a = yS = 1/2, then 

max,,/; 1 {Zl -Z4r-{Z2-Zif I 

£162 < 

- 1/4. 
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The maximum for a - (3 - 1/2 can occur in several ways. One is when z\ - 1, and zi,z-i,zn all 
equal 0. At these values, both devices have an inference accuracy of 1/2 at inferring each other. 
Each device achieves that accuracy by perfectly inferring one probe of the other device, while 
performing randomly for the remaining probe. 

Similarly, say that we have a volume measure dfi over U, as in Sec. |5] together with a proba- 
bility measure P over U . Then we can modify the definition of the length of x to be -]HI(t/ | x), 
the negative of the Shannon entropy under prior cLfx of P(u \ x). If as in statistical physics P is 
proportional to dfi across the support of P, then P{u \ x) oc d^(u \ x), and these two definitions of 
the length of x are the same. 

There are several ways to combine this new definition of length with the concept of inference 
accuracy to define a stochastic analog of inference complexity. In particular, we can define the 
stochastic inference complexity of a function F with respect to C for accuracy e, as 

K(r \C) ^ min,:E,(F/(r)|.)>.[-H(t/ | x)] 

assuming the sum exists for e. So for example if P is proportional to dfx across the support of P 
and C > F, then for e = 1, K(r | C) = <^(F | C). 

One can extend this stochastic framework to include inference of the probability of an event, 
e.g., have the device say whether P{T - y) has some specified value. Such inference contrasts 
with inference accuracy, which (like non-stochastic inference) simply concerns a device's con- 
cluding whether an event occurs, e.g., concluding whether F(m) - y). One can also define stochas- 
tic analogs of (semi)control, strong inference, etc. Such extensions are beyond the scope of this 
paper. 

9. Self-aware devices 

We now return to scenarios where U has no associated probability measure. We consider 
devices that know what question they are trying to answer, or at least "think they do". Rather 
than encode that knowledge in the conclusion function of the device, we split the conclusion 
function into two parts. The value of one of those parts is (explicitly) a question for the device, 
and the other part is a possible associated answer We formalize this as follows: 

Definition 12: A self-aware device is a triple {X, Y, Q) where {X, Y) is an inference device, Q is 
a question function with domain U where each q e Q{U) is a binary function of U, and Y^Qis 
surjective onto B x Q{U). 

Intuitively, a self-aware device is one that (potentially) knows what question it is answering in its 
conclusion. When [/ = m, we interpret q = Q{u) as the question about the state of the universe 
(i.e., about which subset of U contains the actual u) that the conclusion Y(u) is supposed to 
answer The reason we require that Y ® Qhe surjective onto B x QiU) is so that the device is 
allowed to have any conclusion for any of its questions; it's the appropriate setting of X(u) that 
should determine what conclusion it actually makes. 

So one way to view "successful inference" is the mapping of any q e Q{U) to an x such that 
X{u) = x{u) both implies that the device's conclusion to question q is correct, i.e., Y(u) - q(u), 
and also implies that the device is sure it is asking question q, i.e., Q(u) - q. As an example, 
say we have a computer that we want to use make a prediction. That computer can be viewed as 
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an inference device. In this case the question q that the device is addressing is specified in the 
mind of the external scientist. This means that the question is a function of u (since the scientist 
exists in the universe), but need not be stored directly in the inference device. Accordingly, the 
combination of the computer with the external scientist who programs the computer is a self- 
aware device. 

To formalize this concept, we must first introduce some notation that is frankly cumbersome, 
but necessary for complete precision. Let be a value in some space. Then we define b_ as the 
constant function over U whose value is b, i.e., u e U —> b. Intuitively, the underline operator 
takes any constant and produces an associated constant-valued function over U. As a particular 
example, let T be a function with domain U. Then £ is the constant function over U whose value 
is the function F, i.e., m e [/ — > F. Similarly, let B be a set of functions with domain U, and let 
A be a function with domain U whose range is B (so each A{u) is a function over U). Then we 
define A as the function taking u e U ^ [A(m)](m). So the overline operator turns any function 
over U whose range is functions over U into a single function over U. Both the underline and 
overline operators turn mathematical structures into functions over U\ they differ in what type 
of argument they take. In particular, for any function F over U, (F) = F. (Using this notation is 
more intuitive in practice than these complicated definitions might suggest.) 

Next, recall from Sec. 11.11 that for any probe / of a function F with domain U, /(F) is the 
function u e U ^ /(F(m)). 

Definition 13: Let D = (X, Y, Q) be a self-aware device. 

i) A function F is intelligible to D iff V / g 7r(F), /(F) e Q(U). 

ii) D is infallible iff Vm e U, Y(u) = [Q(u)]{u). 

We say that D is infalUble for Q' c Q(U) iff Vg' 6 2', Vu e_U such that Q(u) = q, Y(u) = q(u). 
So D is infallible iff it is infallible for Q(U) if[ Y ^ Q iff YQ = J_. If a device is not infalUble, we 
say that it is fallible. 

Recall that Y ^ Q is supposed to represent the original conclusion function "split into two 
parts". Accordingly, in keeping with the terminology used with weak inference, we say that a 
self-aware device {X', Y', Q') is intelligible to a self-aware device (X, Y, Q) iff (F' , Q') is intelli- 
gible to {X, Y, Q). 

Def. 13 provides the extra concepts needed to analyze inference with self-aware devices. Def. 
13(i) means that D is able to ask what the value is of every probe of F. Def. 13(ii) ensures that 
whatever the question D is asking, it is correctly answering that question. Finally, the third part 
of "successful inference" — having the device be sure it is asking the question q — arises if D 
semi-controls its question function. 

These definitions are related to inference by the following results: 

Theorem 6: Let Di be an infallible, self-aware device. 

i) Let F be a function intelligible to Di and say that Di semi-controls Qi. Then (Xi, Yi) > F. 

ii) Let D2 be a device where Y2 is intelligible to Di, semi-controls (Qi,X2), and {Qi,X2) 
is surjective onto Qi(U) x X2(U). Then (Xi, Fi) » (X2, Y2). 

Thm. 6 allows us to apply results concerning weak and strong inference to self-aware devices. 
Note that a special case of having Di semi-control Qi is where X - x ^ Qi for some function 
X, as in Ex. 1 . For such a case, Y and X "share a component", namely the question being asked, 
specified in gi. 
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The following result concerns just intelligibility, without any concern for semi-control or in- 
falhbility. 

Theorem 7: Consider a pair of self-aware devices D = {X, F, Q) and D' = {X\ Y' , Q') where 
there are functions R, P, R' , P' such that P and P' have domain U,Q^ R{P) and Q' = R'{P'). If 
P is intelligible to D' and P is intelligible to D' then the following hold: 

i) \Qm = \Q'{U)\ = \P(U)\ = \P'{U)\. 

ii) If Q{U) is finite, g' = n{P) = 7r(0 and g = n{P') = 7r(2')- 

In particular, take R and 7?' to be identity functions over the associated domains, so that P - Q 
and P' = Q'. Using this choice, Thm. 7 says that if each self-aware device can try to determine 
what question the other one is considering, then neither device can try to determine anything 
else. 

An immediate corollary of Thm. 7 is the following: 

Corollary 4: No two self-aware devices whose question functions have finite ranges are intelli- 
gible to each other. 

Note that CoroU. 4 does not rely on the devices being distinguishable (unlike Thm. 1). Indeed, 
it holds even if the two devices are identical; a self-aware device whose question function has a 
finite range cannot be intelligible to itself. 

Coroll. 4 is a powerful limitation on any pair of self-aware devices, D and D'. It says that 
for at least one of the devices, say D, there is some question q' e Q'{U) and bit b', such that D 
cannot even ask, "Does D' pose the question q' and answer with the bit b'T\ So whether D could 
correctly answer such a question is moot. 

To circumvent Coroll. 4 we can consider self-aware devices whose conclusion functions alone 
are intelligible to each other However combining Thm.'s 1 and 3(i) gives the following result: 

Corollary 5: Let Di and D2 be two self-aware devices that are infallible, semi-control their 
questions, and are distinguishable. If in addition they infer each other, then it is not possible that 
both Y2 is intelligible to Di and Yi is intelligible to D2. 

With self-aware devices a device Ci may be able to infer whether a self-aware device D2 
correctly answers the question that D2 is considering. To analyze this issue we start the following 
definition: 

Definition 14: If Di is a device and D2 a self-aware device, then Di corrects D2 iff 3 xi such 
that Xi = XI ^ Fi = Fza. 

Def. 2 means that Fi = 1 iff F2 = Q2, i-C-, Y2(u) - [Q2{u)]iu). Intuitively, if a device Di corrects 
D2, then there is an xi where having Xi = xi means that Ci's conclusion tells us whether D2 



Say that D[ is also self-aware, and that 72 22 has both bits in its range (so that probes of it are well-defined). Then we 
can modify the definition to say that Z)| corrects D2 iff two conditions are met: all probes in jt{Y2Q2) are intelligible to 
Di, and Di is infalhble for ^(7222)- 
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Note how weak Def. 14 is. In particular, there is no sense in which it requires that Di can assess 
whether Y2{u) - q2(u) for all questions q2 e QiiJJ). So long as D\ can make that assessment for 
any question in QiiU), we say that Di corrects D2. Despite this weakness, we have the following 
impossibility result, which is similar to Prop. 2(i): 

Proposition 7: For any device Di there is a self-aware device D2 that Di does not correct. 

There are similar results for the definition of correction in footnote[TOl and for the (im)possibility 
of correction among multiple devices. 

Finally, while there is not room to do so here, many of the concepts investigated above for 
inference devices can be extended to self-aware devices. For example, one might want to modify 
the definition of inference complexity slightly for self-aware devices. Let D be a self-aware 
infallible device that semi-controls its question function and F a function over U where T{U) is 
countable and F is intelligible to D. Then rather than ^(F | {X, Y)), it may be more appropriate 
to consider the self-aware inference complexity of F with respect to D, defined as 

/eT(r) 

Similarly, consider a reality that includes self-aware devices, i.e., a reality {U\ {F^}) that can be 
written as {U; {Ca}', [Ds]', {F^j) where in addition to the set of functions {F;?} and devices [Ca], 
we have a set of self-aware devices [Ds]. For such a reality it often makes sense to consider an 
augmented reduced form, 

U ®^^a{u), Ya{u)) ® (g) Tpiu) ® ^{Xsiu), Ysiu), Qs{u)) ® (g) Qs{U) 

iieU [a p S 5 

The last term means we include in the tuples all instances of the form [2(m)](m') in which a 
self-aware device's question for one u is evaluated at a different u' + u. 

Due to page limits the analysis of such extensions is beyond the scope of this paper. 

We close with some comments on the relation between inference with self-aware devices and 
work in other fields. Loosely speaking, in the many-worlds interpretation of quantum mechan- 
ics [25J, "observation" only involves the relationship between Y and F (in general, for a Y whose 
range is more than binary). As discussed above, such relationships cannot imbue the observation 
with semantic meaning. It is by introducing X and Q into the definition of self-aware devices that 
we allow an act of "observation" to have semantic meaning. This is formalized in Thm. 6, when 
it is applied to scenarios where weak inference is interpreted as successful observation. 

Much of formal epistemology concerns "knowledge functions" which are maps from subsets 
of U to other subsets of U 142 43 .45.44] . Ki{A), the knowledge function K/ evaluated for an 
argument A Q U, is interpreted as the set of possible worlds in which individual / knows that 
A is true. The set A is analogous to specification of the question being asked by a self-aware 
device. So by requiring the specification of A, knowledge functions involve semantic meaning, 
in contrast to the process of observation in the many-worlds interpretation. 

A major distinction between inference devices and both the theory of knowledge functions and 
the many-worlds definition of observation is that inference devices require that the individual / 
observer be able to answer multiple questions (one for each probe concerning the function being 
inferred). As mentioned above, this requirement certainly holds in all real-world instances of 
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"knowledge" or "observation". Yet it is this seemingly innocuous requirement that drives many 
of the results presented above. 

Future work involves exploring what inference device theory has to say about issues of interest 
in the theory of knowledge functions. For example, analysis of common knowledge starts with a 
formalization of what it means for "individual ; to know that individual / knows A". The inference 
devices analog would be a formalization of what it means for "device D to infer that device C 
infers F". Now for this analog to be meaningful, since D can only infer functions with at least 
two values in their range, there must be some sense in which the set U both contains "m under 
which C infers F" and contains u under which it does not. Formally, this means two things. First, 
it must not be the case simply that C > F, since that means that C infers F under all u. Second, 
there must be a proper subset Uc c U such that if U were redefined to be Uc (and C and F were 
redefined to have f/c ^is their domains in the obvious way), then it would be the case that C > F. 
This proper subset specifies a binary-valued function, Fc, by Fc(m) = 1 o m e Uc- The question 
of whether "D knows that C knows F' then becomes whether D can infer Fc. 
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APPENDIX A: Proofs 

This section presents miscellaneous proofs. Since many of the results may be counter-intuitive, 
the proofs are presented in elaborate detail. The reader should bear in mind though that many of 
the proofs simply amount to "higher order" versions of the Cretan liar paradox. Cantor diago- 
nalization, or the like (just like many proofs in Turing machine theory). At the same time, in the 
interest of space, little pedagogical discussion is inserted. Unfortunately, the combination makes 
many of the proofs a bit of a slog. 

Proof of Prop. 1: To prove (i), choose a device (X, Y) where Y(u) = -1 <^ m € W. Also have 
X(u) take on a separate unique value for each u €W, i.e., € W,u e U : w i= u, X(w) + X(u). 
(Note that by definition of W, it contains at least two elements.) So by appropriate choice of an 
X, X(u) = X forces u to be any desired element of W. 

Choose i. Pick any y € F,(f/), and examine the probe / that equals 1 iff its argument is y. If 
for nou €W does Fi(M) = y, then choose any x that forces m e 1^. By construction, X(u) - x ^ 
Y{u) = -1, and in addition X(m) = x ^ /(F,(m)) = -1. So X(u) = x Y(u) = /(F,(m)), as 
desired. 

Now say that there is a m e such that r,(M) = y. By hypothesis, 3m" e W : F,(m") ^ y. By 
construction, there is an x such that X(u') - x ^ u' = u" . So X{u') = x m' e W;F,(m') y. 
The first of those two conclusions means that F(m') = -1. The second means that /(F,(m')) = ~1- 
So again, X{u) = x => Y{u) = /(F,(m)), as desired. There are no more cases to consider. 

To prove (ii), choose b € M and let F be a function with domain U where F(m) = b for all u 
obeying Y(u) = -1 and for no others. (The surjectivity of Y ensures there is at least one such m.) 
Consider the probe / of F(f/) that equals -i-l iflf F(m) = b. For all u€U, /(F(m)) = -F(m). QED. 

Proof of CoroU. 2: To prove the first part of the corollary, let a and yS be the partitions induced 
by X and Y, respectively. If |^(f/)| = \a\ = 2, |a| = Since a is a fine-graining of jS, this means 
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that or = yS. So without loss of generaUty we can label the elements of X(U) so that X = Y. 

Now hypothesize that C > T for some F. Recall that we require that |r(J7)| > 2. Let y and y' 
be two distinct elements of r( U) where r{u) - j for some mgX'(-I). Define fy to be the probe 
of TiU) that equals 1 iff its argument is y, and define fy similarly. C > T means 3 Xy e X{U) 
such that X(u) = Xy => fy(r(u)) - Y(u) = X(u) - Xy. Since 3 u € X~^(-l) such that r(M) = y, 
and since Y(u) = -1 Vm e X^^(-l), Xy must equal 1. 

This means that r(M) equals y across all of X~^(Xy) c U. Therefore 3 m g X~^(-Xy) such that 
r(u) = y. Moreover, since Xy = Y(X-\xy)) = 1, Y(X-H-Xy)) = -1. Therefore 3 m 6 ^-'(-Xy) 
such that /y(r(M)) Y(u). Similarly, V m e fyir(u)) + Y{u). Therefore there is no 

Xyi e X{IJ) such that X(u) = Xy ^ fyiT{u)) = Y{u). So our hypothesis is wrong; there is no 
function that C infers. 

Now consider the case where lal > 2. Label the two elements of yS as +1 and -1. Since a is a 
fine-graining of yS, and since = 2, there are at least two distinct elements of a that are contained 
in the same element of /3, having label b. Choose one of those elements of a, a, and let a' be one 
of the other elements of a that are contained in that element of /3 with label b. 

Form the union of a with all elements of a that are contained in the element of yS with label -b. 
That union is a proper subset of all the elements of a. Therefore it picks out a proper subset of U, 
W. (Note that W has non-empty overlap with both both partition elements of p.) So choose T to 
be binary-valued, with values given by r{u) = b iif u e W. Then for X(u) = a, r{u) - b - Y(u). 
On the other hand, for X{u) - a', r{u) - —b = —Y{u). So for both probes / of T, there is a value 
X such that X = x ^ F = /(F). QED. 

Proof of Thm. 1: Let C\ and C2 be the two devices. Since Y for any inference device is surjective, 
YiiU) = B, and therefore there are two probes of Y2{U). Since by hypothesis C\ weakly infers 
C2, using the identity probe f{y e B) = y establishes that 3 x\ s.t. X\{u) - x\ => Fi(m = Y2. 
Similarly, since C2 weakly infers C\, using the negation probe f{y) = -y estabhshes that 3 xi s.t. 
X2{u) = X2 Yiiu) = -Y\(u). Finally, by the hypothesis of setup distinguishabihty, 3 u* € U 
s.t. Xi(u*) = Xi,X2iu*) = X2. Combining, we get the contradiction Fi(m*) = FzCm*) = -Fi(m*). 
QED. 

Proof of Thm. 2: To establish (i), let / be any probe of F(f/). C2 > F => 3 X2 such that 
X2iu) = X2 => Y2(u) - /(F(m)). In turn, Ci » C2 => 3 xi such thatXi = xi => Fi = F2,X2 = X2 
(by choosing the identity probe of Y2(U)). Combining, Xi = xi => Fi(F). So C\ > F, as claimed 
in (i). 

To estabUsh (ii), let / be any probe of Yj,iU), and X2 any member of X^iU). C2 » C3 ^ 3 X2 e 
X2(U) such that X2(u) = X2 => X^iu) = X3, F2(m) = /(F3(m)). Ci » C2 then implies that 3 x\ 
such that Xi(u) = xi ^ X2(u) = X2, Fi(m) = F2(m) (by choosing the identity probe of Y2(U)). 
Combining, Xi{u) = Xi => X3(m) = X3, Fi(m) = /(F3(m)), as desired. QED. 

Proof of Prop. 2: To establish the first claim, simply take F2 to be the function F in Prop. l(ii). 

To estabUsh the second claim, focus attention on any x\ g Xi{U), and define W = Xj"^(xi). 
Choose X2 so that X2iu) take on a separate unique value for each u e W, i.e., "iw e,u & U : 

w U, X2(w) + X2(u). 

First consider the case where Fi(iy) has a single element, i.e., Fi(m) is the same bit across all 
Xj^'(xi). Without loss of generality take that bit to be 1. Choose F2(m) = 1 for some w' g W, 
and F2(m) - -1 for all other w e W. Then choose X2 so that X2{u) - X2 ^ u - w' . Therefore 
X2{u) = X2 => X\{u) = xi,F2(m) = 1. So for the probe / of Yi{U) that equals Fi, X2{u) = 
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X2 => FiC") = /(i'i(M)). On the other hand, by hypothesis 3w" & W that differs from w', and 
3 e X2(C/) such that Xiiu) - x'^^ u - w" . Moreover, F2(w") = -1, by construction of F2- 
So consider the probe /' of Y\{U) that equals -Y\. For all m e W, /'(Fi(m)) = -1. In particular, 
this is the case for u = w". Combining, X2iu) = => Xi{u) = xi, F2(m) = f'iYi(u)). Since / 
and /' are the only probes of Yi{U), there are no more cases to consider for the situation where 
is a singleton. 

If Fi(H^) is not a singleton, since W contains at least three elements, there is a proper subset 
of W, W, on which Yi takes both values. So by Prop. l(i) there is a device C over W that infers 
the restriction of Yi to domain W. Define (X2, Y2) to be the same as that C for all u e W, with 
all members of X2iW) given values that are not found in X2(U - W). Since Xi(w) = xi for all 
w eW, this means that V / e 7r(Fi), 3 X2 such that X2(m) - X2 ^ Xi(u) - xi,Y2(u) - .f(Y\(M))- 

Combining, since Yi(X^\xi)) either is or is not a singleton for each xi e Xi(U), we can build 
a "partial" device C2 that strongly infers Ci for each region X^\xi). Furthermore, those regions 
form a partition of U. So by appropriately "stitching together" the partial C2's built for each 
xi € Xi{U), we build an aggregate device C2 that strongly infers Ci over all U, as claimed. 
QED. 

Proof of Thm. 3: Let Ci and C2 be two devices and hypothesize that they can strongly infer each 
other. Since Ci can strongly infer C2, it can force X2 to have any desired value and simultaneously 
correctly infer the value of Y2 under the identity probe. In other words, there is a function : 
X2(U) — > Xi(U) such that for all X2, Xi = ^]{x2) ^ X2 - X2 and Y\ - Y2- Let x\ be any element 

0f^](X2(f/)). 

Similarly, by hypothesis C2 can force X\ to have any desired value and simultaneously cor- 
rectly infer the value of Yi under the negation probe. In other words, there is a function : 
Xi{U) X2(U) such that for all xi, X2 = f_i(xi) ^ Xi = xi and Yi = -Y2. 

Define X2 = ^i/(xi). Then Xi(u) = ^j(x2) => X2iu) - X2 - ^^/(xi) and Fi(m) = Y2iu). 
The first of those two conclusions in turn means that Yi(u) = -Y2iu). Combining, we see that 
X\(u) = ^]ix2) => F2(m) = Fi(m) = -F2(m), which is impossible. QED 

Proof of Thm. 4: Since C2 > F, V / e 7r(F), 3 X2 such that X2 = X2 ^ F2 = /(F). Therefore 
the set aigrnmx2:X2=x2=>¥2=f(r)[-^ix2)] is non-empty. Accordingly, V/ e 7r(F), we can define an 
associated value x^ € X2(U) as some particular element of argmin^.2:x,=j:2^F,=/(r)[^(-^2)]- 

Now since Ci » C2, Vx2, 3 xi such that Xi = xi =^ X2 = X2, Fi = F2. In particular, V/ 6 7r(F), 
3 xi : Xi = xi => X2 = x^, Fi = F2. So by definition of x^, V/ e ;r(F), 3 xi : Xi = xi => X2 = 

Combining, V/ G 7r(F), 

ram^,:X,=x,^Y,=f(D[^iXl)] < ^;,,:X,=x,^X2=4,Y^=Y2^-^^^^^^- 

Accordingly, 



"^(F I Ci) - "^(F I C2) < X min. 



W-Xl=Xi=^X2=/2,Yl=y2 



[^ixi)-^i4)] 
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Using the equality |;r(r)| = \T(U)\ completes the proof. QED. 



Proof of Thm. 5: By hypothesis, for any e X2(U), 3 x\ such thatXi - x\ ^X^- x^. This is 
true for any such x'^. Write the function mapping any such x!^ to the associated x\ as . Similarly, 
there is a function ^2 that maps any xi e Xi(U) to an X2 e X2(U) such that X2 - ^2(xi) = 
xi. Using the axiom of choice, this provides us with a single-valued mapping from Xi{U) into 
X2(U) and vice-versa. 

Since having X2(u) - ^2(^1) forces Xi(u) = xi, the set of u € U such that X2(u) - ^2(xi) must 
be a subset of those u e U such that Xi(u) = xi, i.e., V xi, X2'[^2(.«i)] £ '(-^i)- Similarly, 
V X2, Xj"'[^i(x2)] c ^2 '(X2). This second equality means in particular that Xy^[^\[^2ixi))] Q 
X-\^2(xi)). Combining, X-'imiixi))] Q X-'(xi). 

However V xi, ^i{^2{xi)) is non-empty. Since Xi is single-valued, this means that V xi, 
^i(^2(x\)) = xi . Combining, we see that V xi, Xj"'(xi) c X2'[^2(-*^i)], and therefore X2'[f2(.^i)] = 
Xj"'(xi). This in turn means that the set X2[X^\xi)] equals the singleton ^2(x\) for any x\ e 
Xi{U). Accordingly V m e X^^(xi), X2(u) - ^2{x\) - ^2iXiiu)). In addition, every u e U obeys 
u € X^^(x\) for some x\. Therefore we conclude that for all u eU, ^2iX\(u)) - X2(u). 

This establishes that the partition induced by Xi is a fine-graining of the partition induced 
by X2. Similar reasoning establishes that the partition induced by X2 is a fine-graining of the 
partition induced by X\ . This means that the two partitions must be identical. QED. 

Proof of CoroU. 3: By Thm. 5, we can relabel the image values of the two devices' setup func- 
tions to express them as Ci = (X, Yi) and C2 - (X, Y2). 

To prove (i), note that d > C2 means 3 x e XiU) such that X = x =f Fi = ^2 and 3 x' e XiU) 
such that X = x' Yi = -Y2. But those two properties in turn mean that C2 > Ci. A similar 
argument estabhshes that C2 > Ci Ci > C2. 

To prove (ii), note that Ci » C2 means that Vx e X(u),f e 7r(F2), 3 x' such that X = x' => 
X = X, Fi = /(F2). In particular, Vx e X(u), 3 x' such that X = x' ^ X = x,Yi = Y2, and3 x" 
such that X = x" ^ X = x,Yi = -Y2. The only way both conditions can hold is if x' = x". But 
that means it is impossible to have both Yi = Y2 and Yi = -Y2. 

To prove (iii), hypothesize that Ci control X. This means in particular that Vx € X(U), 3 x' e 
X(U) such that X = x' => Fi - 5x,x = 1 (choose b = I and have / be the probe that equals 
1 iff its argument equals x). To have 6x^ = 1 means X = x, which in turn means x' = x. So 
X = X => Fi = 1. This is true for all x € X{U), so Y\(u) = 1 Vm € f/. However by definition, 
the range of Y\ must be B. Therefore the hypothesis is wrong. The same argument shows that C2 
cannot control X. QED. 

Proof of Thm. 6: To prove (i), let / be any probe of Y. Intelligibility means / e Q\{U). Since 
Di semi-controls its question function, 3xi : X\ - x\ ^ Q\ = f. Infallibihty then implies that 
for any u such that Xi(m) = xi, Fi(m) = [Q\(u)](u) = f(u). This proves (i). 

Next, let / be any probe of Y2, and X2 any element of X2(U). Intelligibihty means / e Qi{U). 
Since Di semi-controls ((2i,X2) and ((2i,X2) is surjective, 3xi suchthatXi = xj => 2i = /, X2 = 
X2. Infallibihty then implies that for any u such that Xi(u) - xi, Fi(m) = [Qiiu)](u) = f(u). This 
proves (ii). QED. 

Proof of Thm. 7: The cardinahty of n(P) is the cardinality of PiU), \PiU)\. Let fi and /2 be two 
separate such probes, so that fi : P(U) — > B differs from /i : PiU) —> B. Then as functions 
over U, fi{P) and f2{P) differ. Therefore by hypothesis they correspond to two distinct q's in 
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Q'iU). So \Q'm > \Pm. In turn, \Q{U)\ = \R{P{U))\ < |P(f/)|. So \Q'iU)\ > \Q{U)l Similar 
reasoning establishes that \Q(U)\ > \Q'{U)\. So \Q(U)\ = \Q'{U)\. Therefore \QiU)\ = \P(U)\ and 
\Q'(U)\ = \P'iU)\. This proves (i). 

Now since P' is intelligible to D, every / e niP') is an element of QiU). Therefore for 
finite, (i)'s conclusion that = \P'(U)\ means that there is no <7 € Q(U) that is not an element 

of n(P'). In other words, Q = n(P'). Next, (i)'s conclusion that \P'(U)\ = \R'(P'(U))\ estabhshes 
that the partition induced by P' is identical to the partition induced by R'(P'). So niP') = n{Q'). 
Similar reasoning establishes that Q' = n{P) = n{Q). This establishes (ii). QED. 

Proof of Coroll. 4: Choose P = (Y, Q) and R : (F, Q){u) Q(u). (So R is a projection map.) 
Since (Y, Q) is surjective, \P(U)\ = \(Y, Q)(U)\ = 2\Q(U)\. By Thm. 7, this is impossible if the two 
self-aware devices are intelligible to each another. QED. 

Proof of Prop. 3: The validity of the claim in (i) is independent of the question function of the 
devices, so they can be set arbitrarily. Choose Xi{U) = X2{U) = XjiU) - {0, 1). Then choose the 
reduced form of the setup and conclusion functions of the devices in the reality to be the following 
four tuples: ([0, 0], [0, 0], [0, 0]); ([0, 0], [[1, 0], [1, 1]); ([1, 1], [0, 0], [1,0]); ([1, 1], [1, 0], [0, 1]). 
It is straightforward to verify that each pair of devices is distinguishable and that Ci > C2 > 
C3 >Ci. 

To prove (ii), note that under hypothesis, Ci > C2 => 3 xi : Xi = xi => Fi = Y2, C2 > 

3 X2 '■ X2 - X2 ^ Y2 = F3, ...,C„-i > Cn ^ 3 Xn-i = X„-l => y„_l = Y„, 

Cfi ^ C\ 3 Xfi Xfi — Xfi Yfi — -Yi . Mutual distinguishability means that there is a tuple 
in the reduced form of the reality having that set of x, values. However that would mean that the 
tuple has y\ = -y\ . So our hypothesis is wrong. 

To prove (iii), simply combine Thm. 3 and Thm. 2. QED. 

Proof of Prop. 4: Since D is acyclic and finite, it contains at least one root node. Label one such 
node as Ci . Hypothesize that there is some other root node in the graph. 

Given any D' c D, define S {D') as the union of D' with the set of all nodes in D that are 
successors of a node in D' . Similarly, define P{D') as the union of D' with the set of all nodes 
in D that are predecessors of a node in D' . S{{C\}) c D since by hypothesis there is more than 
one root node. Since D is weakly cormected, this means that S{{Ci)) c P\_S{{Ci})\. Since D is 
acycUc and finite, this means that there is a node Cj e 5 ({Ci )) who has a root node predecessor 
awhereQ^S({Ci)). 

So Cj is a successor of two separate root nodes, Ct and Ci. By transitivity of strong inference, 
this means that Ci » Cj and Q » Cj. By the hypothesis of the proposition, since Ck + C\, 
those two devices are distinguishable. This means it is possible for C\ to force Xj to have one 
value while at the same time C^ forces Xj to have a different value. This is a contradiction. QED. 

Proof of Prop. 5: The proof of (i) is by example. Consider the following set of five quadruples: 

V = {(-1,-1, -1,-1); (-1,-1, 1,-1); (1,-1, -1,1); (1,1, 1,-1), (-1,1, 1,1)} 

By Lemma 1, V is the reduced form of a reality consisting of two devices Ci and C2, where we 
identify any quadruple in V as the value (xi,yi,x2,y2), so that Xi(U) = X2iU) = B. By inspec- 
tion, Ci > C2 (e.g., Xi = 1 =^ Yi = -Y2). Similarly, by inspection Ci andCi are distinguishable, 
and copies of each other. This completes the proof of (i). 
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To prove the first part of (ii), first note that Ci » C2 requires that for all X2, there is (an x\ 
that forces X2 - X2 and Y\ - Y2), and (an X] that forces X2 - X2 and Yi = -Fi)- In other words, 
there is a single-valued map f : X2iU) Xi(U) such that the quadruple (Xi - ^(x2),Yi = 
y\,X2 = X2, Y2 = yi) occurs for some yi in some tuple in the reduced form of the reality while 
(Xi - f(x2), Y\ - y\,X2 - x'2, Y2 - y2) does not occur for any y2 if x'2 + X2, and also does not 
occur for y2 - -y\ if x^ - X2- Similarly, there is a single-valued map ^' : X2(l]) — > Xi([/) such 
that the quadruple QL\ - ^(xa), Y\ = yi , X2 = X2, Y2 = -yi) occurs for some yi in some tuple in 
the reduced form of the reality while (Xi = ^(x2), Fi - yi,X2 - x'^, Y2 - ^2) does not occur for 
any y2 if Xj 4^ X2, and also does not occur for y2 - y\ if Xj = X2. By construction, both £, and 
are invertible. Furthermore, for all X2, ^(^2) + ^'(x2)- So |Xi(J/)| > 2\X2(U)\. On the other hand, 
l-'^i(^^)l = \X2(U)\ because Ci and C2 are copies of each other. Therefore they must have infinite 
setup functions. 

The existence proof for (ii) is by example. Define a set of quadruples 

r = {(1,-1, 1,-1); (2, 1,1,-1); (3, -1,2,1); (4, 1,2,1); (5, -1,3,-1), (6, 1,3,-1),...} 
= {(?, l-2(jmod2), fii/2), 1 - 2(r(j72) mod 2)) : j € N} 

Next, fix any set of spaces cr, where the spaces {yi} = {y2} = B and {xi} = {X2) = N all 
occur in cr. Let 5 be a subset of the Cartesian product of the spaces in cr. Say that for every 
t E T, (xi , yi , X2, >'2) - t for exactly one element of 5 , and no element of S contains a quadruple 
(xi , yi , X2, >'2) i T . (So there is a bijection between S and T, given by projecting any element of 
S onto its four components corresponding to the spaces {x\\, {X2}, {y\ ] and {y2}-) 

By Lemma 1, S is the reduced form of a reality, where we can define XiiU) = {xi), Yi(U) = 
{yi},X2iU) = {X2}, Y2iU) = [y2]. Accordingly group (Xi, Yi) into a device Ci and (X2, Y2) into 
a device C2. By inspection, the relation in T between pairs xi and yi is identical to the relation 
in T between pairs X2 and y2. (Those relations are the pairs {(1, -1); (2, 1); (3, -1), . . .}.) So the 
devices Ci and C2 in the reality are copies of each other. 

Next, note that Vx2 e N,yi e B, (2x2 + ^^^,y\,X2, 1 - 2(x2 mod 2)) occurs (once) in T. 
Accordingly, Xi - 2x2 + ^^^j^ ^ X2 - X2. Also, for any fixed X2, choosing either Xi - 2x2 
or Xi = 2x2 - 1 forces yi to be either 1 or -1, respectively. Therefore, given that X2 is fixed, it 
also forces either y^ = I - 2{x2 mod 2) or -yi = 1 - 2(x2 mod 2). (For example, Xi = 5 forces 
X2 = 3 and Yi - Y2, while Xi - 6 forces X2 = 3 and Yi = -Y2.) So the choice of Xi forces either 
Yi = Y2 or Yi = -Y2. Therefore Ci » C2. QED. 

Proof of Prop. 6: Plugging in, the product of the two inference accuracies is 



Define g = Y1Y2. Then we can rewrite our product as 

/ max;ti [Ep(g I xi)] maX;^! [Hp (-g I xQ] \ / max^JEp(g | X2)] max^^[Ep(-g \ X2)] 

\ 2 2 j\ 2 ^ 2 

For \Xi{U)\ = \X2iU)\ = 2, we can rewrite this as 




|Ep(g I Xi = 1) - Ep(g I Xi = -1)|\ /|Ep(g I X2 = 1) - Ep(g I X2 = -1)1 
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Next, since the distinguishability is 1 .0, Xi and X2 are statistically independent under P. There- 
fore we can write P(g,x\,X2) = Pig I xi, X2)Pixi)P{x2). So for example, P{g \ xi) = ^1x2 ^(S I 
xi,X2)P(x2), and 

^P(g I ^1) = Yj[P(g =1\X1,X2)-P(g = -1\ XUX2)]P(X2) 
= 2[J]P(^ = lUi,X2)P(X2)]-l. 

X2 

Now define zi =P{g=\\xi= -l,X2 = -l),Z2 = Pig = I \ xi = -l,X2 = l),Z3 = P{g = I \ 
xi = l,X2 = -1),Z4 = Pig = 1 I xi = 1,^2 = 1). Note that the 4-tuple (21,22,23,24) e // so long 
as none of its components equals 0. Plugging in, 

Epig I Xi = -1) = 2[2ij8 + 22(1 -jS)] - 1, 

Epig I Xi = 1) = 2[23y8 + 24(1 -m-h 
Ep(g I X2 = -1) = 2[2ia + 23(1 

Epig I ^2 = 1) = 2[22a + 24(1 - a)] - 1. 
So the product of inference accuracies is 

mkiz)) + miz)][aikiz) + n(z)]| = \a/3[kiz)f + akiz)miz) +pkiz)niz) + m(z)n(z)|. 

This establishes the first part of the proposition. Note that depending on the structure of the 
mapping from iXi,X2) — > (Fi, F2), if we require that both 7, be stochastically surjective, there 
may be constraints on which quadruples z & H are allowed. Such restrictions would make our 
bound be loose. 

When a - p - 1/2, the product of inference accuracies reduces to 

1 ^1-^2-4+^^4 2223 -2124 , ^ (2l - 24)^ - (22 - 23)^ . 
'4 2 ' ' 4 ' 

This establishes the second claim. The final claim is established by maximizing this expression 
over//. QED. 

Proof of Prop. 7: Given any C\ = iX\, Y\), the proposition is proven if we can construct an 

associated D2 that Ci does not correct. To do that, choose Y2 - Fi, and have Q2iU) consist 
of two elements, qi = Yi, and q2 = -Yi. Define 22's dependence on m G U by requiring that 
Yi = -I ^ Q2 = qi (i.e., € U such that Yiiu) = -1, Q2iu) = qi = Yi), and by requiring that 
Fi = 1 o 22 = <?2- (Since Yi is surjective onto B, this defines Q2's dependence on all of U, and 
guarantees that \Q2iU)\ > 2, as required.) 

Plugging in, Q2 = Now the square of both 1 and -1 equals 1. Since Yi = Y2, this means 
that Fi F2 = 1- Combining, Q2 = -Y2Y1. Therefore ^2^2 = -Yi. Therefore it is impossible that 
Yi = Y2Q2, i.e., there is no x\ that imphes this equahty. QED. 

APPENDIX B: The lack of restrictions in the definition of weak inference 

Note that there is additional structure in Ex. 1 that is missing in Def. 3. Most obviously, no 
analog of ^ appears in Def. 3. In addition, Def. 3 does not require that there be a component 
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of X and/or Y that can be interpreted as a question-valued function like Q. Moreover, even if 
it is the case that X - x ^ Def. 3 allows the value imposed on x to vary depending on 
what probe one is considering, in contrast to the case in Ex. 1 . Alternatively, it may be that the 
question Q(u) does not equal the associated probe /k that is being answered, but so long as 
Y{u) = fxiriu)) whenever xiu) ® Q{u) has a certain value, the device "gets credit" for being 
able to answer question fx- In this, the definition of weak inference doesn't fully impose the 
mathematical structure underpinning the concept of semantic information. Phrased differently, 
the impossibility results for weak inference hold even though weak inference only uses some of 
the structure needed to define semantic information. (See Sec.|9]for results that involve all of that 
structure.) 

In addition, it may be that the scientist cannot read the apparatus' output display accurately. 
In this case the scientist would give incorrect answers as to what's on that display. However 
so long as that inaccuracy was compensated, say by a mistake in the observation apparatus, we 
would still say that the device infers T. Any such extra structure that is in Ex. 1 can be added 
to the definition of weak inference in Def. 3 if desired, and the impossibility results presented 
here for weak inference will still obtain. (See Sec.|9]for a formaUzation of inference that contains 
additional structure much like that in Ex. 1.) 

The other examples in Sec.|2]can be cast as instances of weak inference in similar fashions. In 
particular, all of them have additional structure beyond that required in Def. 3. 

It is worth elaborating further this point of just how unrestrictive Def. 3 is. One might argue 
that to apply to things like computers being used for prediction, a definition of inference should 
involve additional formal structure like time-ordering, or stipulations about the Chomsky hierar- 
chy power of the device, or stipulations about physical limits restricting the device's operation 
Uke the speed of light, quantum mechanical uncertainties, etc.. More abstractly, one might ar- 
gue that for a conclusion of a device to be physically meaningful, it should be possible to "act" 
upon that conclusion, and then test through the universe's response to that action whether the 
conclusion is correct. None of this is required. 

Note also that Def. 3 doesn't require that the device be used to infer some aspect of world 
"outside" of the device. For example, no restrictions are imposed concerning the physical cou- 
pling (or lack thereof) at any particular instant of time between the device and what the device 
infers. The device and what it is inferring can be anything from tightly coupled with each other 
to completely isolated from each other, at any moment. 

As an extreme version of the first end of that spectrum, one can even have the device and 
what it is inferring be "the same system". For example, this is the case if X and/or Y depend on 
every degree of freedom in the universe at some moment in time (in some associated reference 
frame). In such a situation, the entire universe is the inference device, and it is being used to infer 
something concerning itself. 

As another example of the generality of the definition, note that time does not appear in Def. 3. 
Ultimately, this is the basis for the fact that the definition of inference applies to both prediction 
and recollection, aka "retrodiction". This absence of time in Def. 3 also means that not only 
might the device be the entire universe, but it might be the entire universe across all time. In such 
a situation, the device is not localized either spatially or physically; the setup and/or conclusion 
of the device is jointly specified by all degrees of freedom of the universe at all moments. 

In addition, X = x ^ Y - /(F) does not mean that Y(u) is the same for every u e X"'(x). It 
simply means that whatever values Y{u) has as u varies across X^\x) are the same as the values 
that f(r(u)) has. This weakness in the definition of inference is necessary for it to accommodate 
observation devices. (Recall that in such devices X(u) is how the observation device is set up. 
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and the conclusion of the device depends on characteristics of the external universe, to be types 
of inference devices.) 

Along the same lines, C > F does not imply that there is exactly one probe of F for which the 
associated conclusion value is 1. (This is true even though ;r(r(f/)) is a full unary representation 
of r(U).) Formally, C > F does not imply that there is exactly one probe / of F such that 
3x:X-x^Y = /(F) = 1 . There may be more than one such /, or even none. So as embodied 
in weak inference, for C to predict (something concerning the future state of the universe as 
encapsulated in the function) F does not mean that for each y e T(U) there is some associated 
question x that if embodied in X guarantees that Y correctly says, "yes, in this universe u, y is 
the value that will occur; F(m) = y". Weak inference only requires that for each y and associated 
probe, X can be set up so that the device's answer Y(u) must be correct, not that it can be set up 
to be correct and answer in the affirmative. 

Similarly, C > F does not imply that C can infer a "coarse-grained" version of F. It imphes 
that C can correctly answer, "does F(m) equal yi ?" for some yi e F(f/), and that it can correctly 
answer "does r{u) equal yx' for some y2 G F(t/). However it does not imply that C can correctly 
answer, "does F(m) equal either yi or y2 or both?". In particular, for two functions over U, F and 
F', C > (F, F') does not imply C > F. 

As another example of how weak Def. 3 is, recall that Y is to be interpreted as including all that 
the device "knows". On the other hand, it is X that includes a specification of what inference task 
the device is being asked to perform. So in the definition of inference, we don't even require that 
the device knows what inference task it is being asked to perform. We just ask if it can be given 
such a task and then come to the right conclusion, even if it doesn't know what its conclusion 
"means". 

There is no reason one could not introduce additional formal structure in the definition of 
inference to embody some (or all) of these attributes. For example, say we want to analyze the 
property of a device C both inferring some F while also being capable of correctly answering 
"does F(m) equal either yi or y2 or both?". We could do this by strengthening the definition of 
weak inference to also require that for any union of probes of F, <1>, there is an x G X{U) such 
that X(u) = X implies that Y{u) = 1 « /(F(m)) = 1 for some / G O. (In general the x G X{U) 
that force the device to infer such unions of multiple probes are different from the x g X{U) that 
force the device to infer single probes.) As another example, say we want to have C infer some 
F while also knowing how it is set up (so in particular it knows what probe of F it is inferring). 
We can accomplish this by requiring C > (F, X). 

Whatever difficulties such additional structures might impose, they are in addition to the im- 
possibihty results we derive below; the results below apply no matter what such additional struc- 
tures are imposed. 

In addition, in Def. 3 there are no restrictions on how, physically, the function F gets mapped 
to the setup value x. So there are no stipulations, implicit or otherwise, about how x is inter- 
preted. A mechanism for forcing X(u) to have the desired value for its inference will typically 
exist in any real device. In fact, in general to infer different functions will require different such 
mechanisms. So in the real world there is typically a way to replace one such mechanism with 
another, depending on the function F being inferred. 

By leaving the mechanism out of the formal definition of inference, all such complications are 
avoided. In Def. 3, we simply say there exists some appropriate x g X(U) for any /(F), with 
nothing mentioned about how to force the inference device (and therefore u) to have what the 
device is supposed to compute, /(F), reflected in the value x. 

Indeed, given any device C, we can define a new device C = (X', Y') where X'(u) itself 
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specifies the /(F) that we wish to answer using the original device (X, Y). So for example, say 
(X, Y) is a computer running a physical simulation program whose initialized state is given by 
X(u). Then C is that computer modified by having a "front end" program that runs first to figure 
out how to initiahze the simulation to have the bit it produces as a conclusion answer the question 
of interest. In this case, trivially, there is no issue in mapping from F to x; that mapping is part of 
the setup function of our new device, X'(.). 

In particular, say that there is an "external" scientist who types into the computer C a specifi- 
cation of the system whose evolution is to be simulated in the computer (i.e., forces X(u) to have 
a value that is interpreted as that specification). Then one can define C so that the scientist is 
embodied in X'{.). In this definition, we view the human scientist as "part of" the device (s)he is 
using. 

In summary, and speaking very colloquially, one can view weak inference as a necessary 
condition for saying that a device "knows" the actual value of a function of the state of the 
universe. Whatever else such knowledge entails, it means that the device can, by whatever means, 
correctly answer (with a yes or a no), "Does the value of the function of the state of the universe 
equal z?" for any value z in the codomain of the function. 

Like with weak inference, there is no requirement that a device knows how it has been set up 
for it to strongly infer another device. Similarly, there is no requirement that it be able to strongly 
infer the unions of probes, no requirements concerning its position in the Chomsky hierarchy, 
etc. Despite being so pared-down, the definition of strong inference is still sufficient to exhibit 
some non-trivial behavior. 



APPENDIX C: Alternative definitions of weak inference 

There are alternatives to Def. 3 that accommodate the case where |r(f/)| > 2 without em- 
ploying multiple probes. One such alternative uses multiple devices in concert, each sharing the 
same setup function, and each device's conclusion giving a different bit concerning F's value. As 
an example, say that F's range is R. Then we could assign each device to a separate real num- 
ber, and require that for all u one and only one device's conclusion equals 1, namely the device 
corresponding to the value of F(m). 

To formahze this, say we have a set of devices {Q : z e R) and some function F : {/ — > R. In 
addition suppose there is some vector x with components running over all z e R such that 

i) n,eRX-\x,) = Ut <z. 

ii) M e f/r ^ Vz e R, 7^ = 1 iff F(m) = z. 

iii) Vy e F(f/), 3m e Ut such that Yy{u) = 1. 

Then we can jointly set up the set of devices so that their joint conclusion gives F(m), and we can 
do so without precluding any element of r(u). In this, the set of devices "jointly infers" F. 

Alternatively, we could use a single device, where we modify the definition of "device" to 
allow arbitrary cardinahty of the range of Y. With this modification, the conclusion function of 
the device does not answer the question of what the value of a particular function of F(f/) is. 
Rather it directly encodes the value of r{U). 

It would appear that under such an alternative we do not need to have the value of X{u) specify 
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the bit concerning r(M) that we want to infer, and do not need to consider multiple probes. So for 
example, it would appear that when the device is being used for prediction, under this alternative 
X{u) need only specify what is known concerning the current state of the system whose future 
state is being predicted, without specifying a particular bit concerning that future state that we 
wish our device to predict. The conclusion Y (or set of conclusions, as the case might be) would 
specify the prediction in full. 

Things are not so simple unfortunately. If we wish to allow the device to infer functions F with 
different ranges, then under this alternative we have to allow different functions relating Y{u) and 
r(u). This need is especially acute if we want to allow |r(f/)| to vary. 

Such functions should be surjective, to ensure that our device can conclude every possible 
value of T(U). (This surjectivity is analogous to the requirement that we consider all probes in 
Def. 3.) For any such function (p : Y{U) ^ F(f/), we would interpret a particular value Y(u) as 
saying "F(m) = 0(F(m))". (This contrasts with the situation when Y{U) - B, where we interpret 
Y{u) - to mean "yes/no", respectively, in response to the question of whether some 

associated probe has the value +1.) 

One immediate problem with this alternative definition of inference is that it does not allow a 
device {X, Y) to infer any function F(f/) where |F(f/)| > |F(C/)|. Such difficulties do not hold for 
Def. 3. For example, if X(U) - 3,X is a fine-graining of Y with two of its elements contained in 
y"'(-l), and F is a fine-graining of X, then (X, Y) > F. (For every probe of F(f/), x is chosen to 
be one of the two elements that cause Y(u) = -1. The precise x chosen for a particular probe / 
is the one that Hes in (/(F))"'(-l)-) 

Other difficulties arise when we try to specify this alternative definition in full. For example, 
one possible such definition is that C infers F iff 3 x and function (p : Y(U) ^ F(f/) such that 
X = jc => (f){Y) = F. Such a definition is unsatisfying in that by not fixing </> ahead of time, it 
leaves unspecified how the conclusion of the device is to be physically interpreted as an encoding 
of F(m). (This is in addition to the lack of a fixed mapping from F to x, a lack which also arises 
in Def. 3.) 

To get around this problem we could pre-fix a set of 0's, one for every member of a set of 
ranges {F(f/)). We could then have u pick out the precise (p to use. This requires introduction 
of substantial additional structure into the definition of devices however. (A somewhat related 
notion is considered in Sec. |9]) Another possible solution would be along the lines of V0 : 
Y(U) F, 3x such that X - x ^ (p(Y) = F". But this returns us to a definition of inference 
involving multiple functions relating Y and F. 

All of these other difficulties also apply to the definition above of joint inference involving 
multiple devices. In particular, say we wish to use the same set of devices to jointly infer function 
having different ranges from one another. Then we have to specify something about how to map 
the joint conclusion of the devices into an inference in any of those ranges. For example, if the 
set of devices is {C^ : z e R) and F(J/) is non-numeric, we would need to specify something 
about how a joint conclusion {Y^iu)} gets mapped into that non-numeric space. 

As a final possibility, we could stick with a single device and have Y(U) - B, but use some 
representation of F(C/) in X other than the unary representation implicit in Def. 3. For example, 
we could require that for all binary representations (f> of F(f/), for all bits / in that representation, 
there is an x such that X - x ^ Y = (piiT). This would allow smaller spaces X(U) in general. But 
it would still require consideration of multiple functions relating Y and F. It would also raise the 
issue of how to encode the elements of F([/) as bits. 

For simplicity, in the text we avoid these issues and restrict attention to the original definitions. 
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